-- Logs begin at Sun 2022-10-30 00:10:27 UTC, end at Sun 2022-10-30 01:08:46 UTC. -- Oct 30 00:41:54.415071 dv-osbrick-master-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Oct 30 00:41:54.424399 dv-osbrick-master-4-iscsi devstack@keystone.service[81338]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 30 00:41:54.426217 dv-osbrick-master-4-iscsi devstack@keystone.service[81338]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 30 00:41:54 2022] *** Oct 30 00:41:54.426217 dv-osbrick-master-4-iscsi devstack@keystone.service[81338]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 30 00:41:54.426217 dv-osbrick-master-4-iscsi devstack@keystone.service[81338]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 30 00:41:54.426217 dv-osbrick-master-4-iscsi devstack@keystone.service[81338]: nodename: dv-osbrick-master-4-iscsi Oct 30 00:41:54.426217 dv-osbrick-master-4-iscsi devstack@keystone.service[81338]: machine: x86_64 Oct 30 00:41:54.426217 dv-osbrick-master-4-iscsi devstack@keystone.service[81338]: clock source: unix Oct 30 00:41:54.426217 dv-osbrick-master-4-iscsi devstack@keystone.service[81338]: pcre jit disabled Oct 30 00:41:54.426217 dv-osbrick-master-4-iscsi devstack@keystone.service[81338]: detected number of CPU cores: 4 Oct 30 00:41:54.426217 dv-osbrick-master-4-iscsi devstack@keystone.service[81338]: current working directory: / Oct 30 00:41:54.426217 dv-osbrick-master-4-iscsi devstack@keystone.service[81338]: detected binary path: /usr/bin/uwsgi-core Oct 30 00:41:54.426217 dv-osbrick-master-4-iscsi devstack@keystone.service[81338]: your processes number limit is 47680 Oct 30 00:41:54.426803 dv-osbrick-master-4-iscsi devstack@keystone.service[81338]: your memory page size is 4096 bytes Oct 30 00:41:54.426803 dv-osbrick-master-4-iscsi devstack@keystone.service[81338]: detected max file descriptor number: 2048 Oct 30 00:41:54.426803 dv-osbrick-master-4-iscsi devstack@keystone.service[81338]: lock engine: pthread robust mutexes Oct 30 00:41:54.426803 dv-osbrick-master-4-iscsi devstack@keystone.service[81338]: thunder lock: enabled Oct 30 00:41:54.426803 dv-osbrick-master-4-iscsi devstack@keystone.service[81338]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 30 00:41:54.426803 dv-osbrick-master-4-iscsi devstack@keystone.service[81338]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 30 00:41:54.465350 dv-osbrick-master-4-iscsi devstack@keystone.service[81338]: Python main interpreter initialized at 0x559efe46f9c0 Oct 30 00:41:54.465350 dv-osbrick-master-4-iscsi devstack@keystone.service[81338]: python threads support enabled Oct 30 00:41:54.465350 dv-osbrick-master-4-iscsi devstack@keystone.service[81338]: your server socket listen backlog is limited to 100 connections Oct 30 00:41:54.465350 dv-osbrick-master-4-iscsi devstack@keystone.service[81338]: your mercy for graceful operations on workers is 90 seconds Oct 30 00:41:54.465693 dv-osbrick-master-4-iscsi devstack@keystone.service[81338]: mapped 403077 bytes (393 KB) for 2 cores Oct 30 00:41:54.465780 dv-osbrick-master-4-iscsi devstack@keystone.service[81338]: *** Operational MODE: preforking *** Oct 30 00:41:54.466019 dv-osbrick-master-4-iscsi devstack@keystone.service[81338]: *** uWSGI is running in multiple interpreter mode *** Oct 30 00:41:54.466019 dv-osbrick-master-4-iscsi devstack@keystone.service[81338]: spawned uWSGI master process (pid: 81338) Oct 30 00:41:54.466218 dv-osbrick-master-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Oct 30 00:41:54.467224 dv-osbrick-master-4-iscsi devstack@keystone.service[81338]: spawned uWSGI worker 1 (pid: 81351, cores: 1) Oct 30 00:41:54.467224 dv-osbrick-master-4-iscsi devstack@keystone.service[81338]: spawned uWSGI worker 2 (pid: 81352, cores: 1) Oct 30 00:41:54.467224 dv-osbrick-master-4-iscsi devstack@keystone.service[81338]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 30 00:41:58.713412 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 00:41:58.713412 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: from cryptography.utils import int_from_bytes Oct 30 00:41:58.714071 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 00:41:58.714071 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: from cryptography.utils import int_from_bytes Oct 30 00:41:58.714215 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 00:41:58.714215 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: from cryptography.utils import int_from_bytes Oct 30 00:41:58.714635 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 00:41:58.714635 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: from cryptography.utils import int_from_bytes Oct 30 00:41:58.764263 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 30 00:41:58.764421 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 30 00:41:58.764513 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 30 00:41:58.764601 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 30 00:41:58.764674 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] command line args: [] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 30 00:41:58.764767 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] command line args: [] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 30 00:41:58.764896 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 30 00:41:58.765028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 30 00:41:58.765117 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ================================================================================ {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 30 00:41:58.765224 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ================================================================================ {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 30 00:41:58.765372 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] admin_token = **** {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.765468 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] admin_token = **** {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.765593 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] config_dir = [] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.765684 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] config_dir = [] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.765756 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.765832 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.765947 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] config_source = [] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.766040 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] config_source = [] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.766120 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] debug = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.766198 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] debug = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.766292 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.767577 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.767577 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.767732 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.767791 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.767848 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.767909 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.767973 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.768041 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.768105 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.768164 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] list_limit = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.768224 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] list_limit = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.768286 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] log_config_append = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.768344 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] log_config_append = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.768407 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.768470 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.768533 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] log_dir = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.768591 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] log_dir = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.768652 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] log_file = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.768715 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] log_file = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.768779 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.768843 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.768900 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.768956 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.769012 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.769067 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.769129 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.769221 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.769287 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.769345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.769401 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.769474 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.769584 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.769676 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.769814 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.769914 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.770095 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.770195 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.770270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.770347 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.770483 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.770597 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.770713 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.770800 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.770942 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.771048 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.771180 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.771258 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.771484 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.771588 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.771969 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.772062 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.772143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] publish_errors = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.772206 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] publish_errors = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.772366 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.772458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.772537 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.772621 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.772693 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.772767 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.772925 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.773075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.773235 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.773324 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.773649 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] standard_threads = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.773743 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] standard_threads = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.773865 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.773952 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.774102 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.774186 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.774263 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.774333 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.774437 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] use_journal = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.774562 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] use_journal = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.774641 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] use_json = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.774712 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] use_json = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.774781 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] use_stderr = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.774856 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] use_stderr = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.774926 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] use_syslog = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.775003 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] use_syslog = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.775134 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.775210 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:41:58.775383 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.775502 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.775617 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.775736 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.775856 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.775969 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.776081 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.776192 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.776304 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.776422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.776536 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.776648 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.776760 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.776871 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.776983 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.777106 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.777245 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.777364 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.777477 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.777589 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.777702 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.777826 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.777941 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.778059 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.778172 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.778284 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.778396 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.778519 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.778639 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.778759 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.778878 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.778999 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.779119 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.779240 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.779847 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.779972 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.780087 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.780199 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.780386 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.780501 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.780614 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.780726 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.780846 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.780965 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.781086 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.781234 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.781395 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.781517 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.781630 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.781743 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.781869 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.781983 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.782096 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.782208 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.782319 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.782431 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.782551 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.782670 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.782785 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.782896 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.783008 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.783120 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.783240 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.783354 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.783466 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.783585 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.783704 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.783818 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.783938 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.784053 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.784161 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.784258 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.784258 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.784440 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.784561 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.784675 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.784791 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.784903 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.785022 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.785144 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.785293 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.785408 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.785520 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.785637 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.785751 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.785862 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.786049 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.786166 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.786278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.786390 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.786502 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.786620 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.786742 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.786861 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.786974 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.787087 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.787197 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.787308 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.787432 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.787531 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.787631 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.787727 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.787820 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.787920 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.788023 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.788120 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.788221 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.788317 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.788411 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.788522 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.788600 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.788712 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.788824 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.788968 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.789090 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.789230 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.789347 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.789460 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.789569 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.789679 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.789797 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.789909 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.790021 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.790134 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.790259 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.790373 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.790486 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.790597 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.790723 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.790850 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.790964 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.791076 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.791187 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.791306 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.791463 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.791594 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.791700 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.791811 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.791929 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.792042 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.792154 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.792274 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.792389 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.792501 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.792619 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.792733 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.792844 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.792968 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.793083 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.793216 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.793333 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.793446 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.793559 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.793683 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.793804 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.793918 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.794030 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.794142 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.794254 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.794374 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.794558 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.794682 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.794797 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.794911 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.795565 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.795697 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.795813 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.795927 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.796040 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.796153 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.796266 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.796387 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.796503 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.796625 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.796739 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.796857 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.796971 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.797092 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.797268 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.797385 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.797504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.797619 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.797743 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.797931 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.798054 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.798175 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.798290 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.798403 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.798524 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.798652 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.798775 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.798891 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.799004 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.799117 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.799230 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.799344 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.799465 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.799580 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.799695 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.799808 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.799931 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.800053 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.800180 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.800296 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.800409 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.800522 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.800635 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.800749 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.800871 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.800986 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.801107 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.801237 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.801363 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.801539 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] auth.external = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.801668 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.801786 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.801908 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] auth.external = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.802024 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.802139 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.802252 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.802366 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.802480 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] auth.password = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.802601 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.802716 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] auth.token = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.802832 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] auth.password = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.802946 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.803060 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] auth.token = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.803174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.803296 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.803412 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.803526 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.803639 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.803753 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.803873 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.803997 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.804113 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.804227 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.804341 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.804454 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.804567 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] credential.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.804689 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.804805 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.804920 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] credential.caching = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.805033 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.805147 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.805320 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.805448 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.805565 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.805679 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.805792 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.805905 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.806019 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.806144 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.806260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.806374 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.806488 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.806607 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.806722 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.806845 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.806968 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.807086 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.807200 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.807314 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.807436 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.807561 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.807677 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.807791 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.807905 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.808019 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.808146 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.808263 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.808377 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] federation.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.808491 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.808605 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.808719 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] federation.caching = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.808840 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.808955 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.809069 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.809184 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.809325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.809441 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.809563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.809685 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.809800 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.809914 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.810028 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.810141 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.810264 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.810380 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.810494 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.810620 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.810736 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.810850 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.810973 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.811089 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.811214 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.811328 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.811441 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.811555 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] identity.caching = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.811778 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.811897 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.812012 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.812127 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.812241 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.812356 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.812478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.812594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.812707 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.812819 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.812940 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.813055 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.813176 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.813325 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.813439 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.813553 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.813667 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.813791 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.813916 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.814040 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.814156 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.814270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.814385 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.814498 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.814498 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.814726 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.814841 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.814955 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.815068 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.815182 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.815304 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.815421 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.815536 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.815651 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.815764 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.815877 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.815999 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.816116 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.816230 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.816344 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.816458 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.816571 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.816693 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.816815 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.816930 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.817043 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.817157 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.817300 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.817420 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.817537 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.817651 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.817765 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.817878 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.818000 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.818116 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.818230 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.818343 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.818458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.818579 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.818702 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.818818 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.818932 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.819047 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.819161 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.819274 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.819396 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.819512 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.819627 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.819741 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.819855 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.819968 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.820091 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.820207 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.820321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.820440 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.820556 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.820670 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.820792 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.820907 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.821022 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.821135 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.821297 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.821412 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.821538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.821655 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.821810 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.821932 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.822047 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.822161 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.822283 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.822417 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.822533 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.822647 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.822762 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.822876 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.822998 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.823113 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.823227 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.823340 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.823454 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.823567 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.823689 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.823806 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.823920 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.824034 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.824148 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.824262 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.824384 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.824500 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.824614 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.824727 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.824842 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.824955 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.825076 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.825235 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.825353 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.825467 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.825581 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.825694 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.825820 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.825939 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.826052 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.826166 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.826296 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.826412 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.826534 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.826651 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.826765 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.826878 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.827016 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.827140 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.827264 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.827385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.827501 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.827615 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.827729 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.827844 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.827967 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.828084 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.828197 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.828312 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.828312 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.828526 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.828649 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.828765 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.828880 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.828880 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.829094 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.829226 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.829355 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.829472 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.829472 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.829693 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.829809 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.829809 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.830031 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.830149 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.830263 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.830377 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.830490 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.830604 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.830726 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.830842 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.830956 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.831070 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.831185 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.831299 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.831299 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.831524 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.831638 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] resource.caching = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.831789 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.831907 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.832021 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.832144 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.832260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.832375 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.832489 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.832603 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.832724 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] resource.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.832840 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.832954 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.833068 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.833181 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.833318 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.833444 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.833561 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.833675 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.833789 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.833903 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.834017 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] role.caching = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.834208 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.834327 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] role.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.834442 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.834557 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.834671 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.834785 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.834907 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.835024 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.835139 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] role.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.835253 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.835368 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] role.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.835482 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.835604 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.835719 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.835834 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.835948 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.836061 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.836174 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.836297 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.836413 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.836527 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.836641 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.836755 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.836868 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.836990 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.837105 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.837288 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.837408 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.837523 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.837636 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.837762 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.837762 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.837762 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.838077 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.838191 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.838304 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.838426 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.838542 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.838542 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.838757 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.838870 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.838991 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.839107 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.839221 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.839335 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.839449 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.839563 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.839685 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.839801 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.839915 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.840028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.840142 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.840255 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.840377 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.840493 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.840608 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.840722 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.840836 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.840950 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.841071 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.841202 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.841320 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.841434 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.841547 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.841662 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.841787 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.842436 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.842552 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.842666 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.842780 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.842901 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] token.caching = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.843024 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.843140 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.843253 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.843368 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.843481 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.843595 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.843717 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] token.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.843834 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.843948 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.844062 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.844175 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.844289 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.844411 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.844526 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.844640 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.844754 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.844868 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.844982 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.845104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.845236 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.845353 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.845467 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.845581 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.845694 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.845820 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.845936 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.846051 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.846164 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.846277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.846390 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.846516 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.846644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.846759 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.846874 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.846987 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.847101 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] database.connection = **** {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.847213 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.847339 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.847463 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.847587 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.847702 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.847816 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.847935 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] database.connection = **** {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.848048 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.848160 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.848282 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.848397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.848511 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.848624 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.848737 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.848850 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.848973 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.849088 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.849264 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.849382 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.849496 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.849609 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.849735 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.849851 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.849965 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.850079 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.850193 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.850306 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.850428 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.850544 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.850659 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.850772 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.850885 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.850999 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.851122 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.851238 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.851352 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.851352 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 30 00:41:58.851567 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.851567 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.851567 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.851567 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:41:58.851567 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 30 00:41:58.878664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:58.878887 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:58.879107 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:58.879472 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:58.879704 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:58.879931 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:58.887393 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:58.888260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:58.916371 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:58.916596 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:58.918321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:58.918554 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:58.970591 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:58.972160 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.019280 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.019512 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.019792 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.020031 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.173408 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.173646 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.173866 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.174084 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.174303 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.174518 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.174607 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.174755 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.174981 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.175201 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.175422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.175641 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.197895 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.198124 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.198207 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.198352 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.198437 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.198578 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.198660 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.198799 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.198880 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.199011 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.199094 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.199222 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.199304 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.199438 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.210348 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.210679 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.223541 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.223721 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.223831 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.223949 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.224064 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.224172 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.224286 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.224389 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.224507 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.224595 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.224724 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.224803 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.224938 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.225152 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:41:59.241925 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.242026 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.242136 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 30 00:41:59.242218 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 30 00:41:59.242475 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.242570 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.242675 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 30 00:41:59.242756 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 30 00:41:59.242949 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.243029 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.243214 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.243303 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.243514 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.243723 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.243802 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.243988 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.253417 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.253603 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.253687 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.253891 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.253972 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.254166 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.254260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.254453 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.261209 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.261462 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.264126 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.264401 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.264484 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.264682 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.264761 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.264969 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.265057 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.265286 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.265367 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.265551 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.265628 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.265823 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.265922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.266099 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.266177 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.266382 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.266486 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.266661 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.266765 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.266940 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.267019 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.267211 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.290359 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.290680 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.291812 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.292097 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.292177 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.292425 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.297678 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.297967 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.298254 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.298985 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.299273 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.299557 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.304621 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.304917 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.306139 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.306429 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.310547 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.310643 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.310867 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.310949 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.311153 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.311234 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.311441 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.311522 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.311724 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.311804 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.312005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.312093 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.312282 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.312361 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.312553 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.312632 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.328085 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.328250 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.328368 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.328528 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.332207 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.332412 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.335449 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.335652 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.335733 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.335948 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.339937 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.340198 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.343598 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.343887 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.346856 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.347125 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.347219 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.347426 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.347505 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.347713 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.347793 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.348004 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.348088 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.348290 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.348371 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.348572 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.364761 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.364950 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.365053 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.365258 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.365341 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.365530 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.365624 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.365795 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.372475 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.372655 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.374085 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.374266 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.375639 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.375808 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.375918 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.376084 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.378699 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.378800 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.378996 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.379077 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.379282 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.379395 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.379564 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.379680 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.379958 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.380046 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.391189 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.391296 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.391474 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.391553 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.391759 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.391847 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.392044 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.392125 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.392401 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.392482 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.392688 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.392776 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.392965 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.393046 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.409218 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.409313 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.412132 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.412220 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.415067 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.415149 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.416572 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.416660 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.418101 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.418220 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.418386 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.418506 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.418783 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.418910 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.425715 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.425819 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.427188 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.427274 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.430123 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.430222 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.430506 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.430587 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.430794 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.430883 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.431072 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.431152 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.438948 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.439041 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.439241 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.439335 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.439526 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.439608 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.446575 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.446865 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.447151 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.447335 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:41:59.447440 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.447624 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.447704 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.447910 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.447997 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.448196 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.448275 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.448474 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.448553 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.448753 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.448843 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.449032 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.449112 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.449336 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.449418 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.449615 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.449746 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.449895 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.450151 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.450254 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.450585 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.450932 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.451218 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.451500 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:41:59.485419 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559efe46f9c0 pid: 81351 (default app) Oct 30 00:41:59.485519 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559efe46f9c0 pid: 81352 (default app) Oct 30 00:41:59.488582 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebbad8-1c01-4017-a357-3a53f566f22c None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:59.488869 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebbad8-1c01-4017-a357-3a53f566f22c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:59.489142 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebbad8-1c01-4017-a357-3a53f566f22c None None] PATH_INFO: `/v3` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:59.493233 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 791 bytes} [Sun Oct 30 00:41:59 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:06.181476 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a4f88-9fac-4969-aaad-fc04ac187afa None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:06.181980 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a4f88-9fac-4969-aaad-fc04ac187afa None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:06.182083 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a4f88-9fac-4969-aaad-fc04ac187afa None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:06.186267 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1/2] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:42:06.191393 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022909b-da16-44f6-bd61-d1c5d9e7f4fe None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:06.191950 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022909b-da16-44f6-bd61-d1c5d9e7f4fe None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:06.191950 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022909b-da16-44f6-bd61-d1c5d9e7f4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:06.262449 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: INFO dbcounter [None req-0022909b-da16-44f6-bd61-d1c5d9e7f4fe None None] Registered counter for database keystone Oct 30 00:42:06.282010 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG oslo_db.sqlalchemy.engines [None req-0022909b-da16-44f6-bd61-d1c5d9e7f4fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 00:42:06.288038 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writer thread running {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 00:42:06.462927 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG passlib.handlers.bcrypt [None req-0022909b-da16-44f6-bd61-d1c5d9e7f4fe None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81351) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 30 00:42:06.463237 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG passlib.handlers.bcrypt [None req-0022909b-da16-44f6-bd61-d1c5d9e7f4fe None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81351) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 30 00:42:06.520769 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-0022909b-da16-44f6-bd61-d1c5d9e7f4fe None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:06.522381 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0022909b-da16-44f6-bd61-d1c5d9e7f4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:06.647549 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 2/3] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 30 00:42:07.133308 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a4f88-9fac-4969-aaad-fc04ac187afa None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:07.202549 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: INFO dbcounter [None req-914a4f88-9fac-4969-aaad-fc04ac187afa None None] Registered counter for database keystone Oct 30 00:42:07.224142 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG oslo_db.sqlalchemy.engines [None req-914a4f88-9fac-4969-aaad-fc04ac187afa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81352) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 00:42:07.230338 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writer thread running {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 00:42:07.347913 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a4f88-9fac-4969-aaad-fc04ac187afa None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:07.352127 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e5e974-f1bf-4f26-823f-5eb69bb44f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:07.352734 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5e974-f1bf-4f26-823f-5eb69bb44f44 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:07.353012 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5e974-f1bf-4f26-823f-5eb69bb44f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:07.353311 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5e974-f1bf-4f26-823f-5eb69bb44f44 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:07.361491 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e5e974-f1bf-4f26-823f-5eb69bb44f44 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:07.412691 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c4e5e974-f1bf-4f26-823f-5eb69bb44f44 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 30 00:42:07.413014 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e5e974-f1bf-4f26-823f-5eb69bb44f44 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:07.422704 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 2/4] 10.222.0.40 () {58 vars in 1324 bytes} [Sun Oct 30 00:42:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 00:42:07.428597 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022909b-da16-44f6-bd61-d1c5d9e7f4fe None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:07.445706 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022909b-da16-44f6-bd61-d1c5d9e7f4fe None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:07.450211 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e3fae-95f6-43c3-8898-ef265b798c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:07.451314 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e3fae-95f6-43c3-8898-ef265b798c04 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:07.451599 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e3fae-95f6-43c3-8898-ef265b798c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:07.451883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e3fae-95f6-43c3-8898-ef265b798c04 admin admin] PATH_INFO: `/v3/projects/34e03b1d71cb423ba48cad74d0a6e7da` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:07.455738 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e3fae-95f6-43c3-8898-ef265b798c04 admin admin] RBAC: Authorizing `identity:get_project(project_id=34e03b1d71cb423ba48cad74d0a6e7da)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:07.505972 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: WARNING keystone.common.rbac_enforcer.enforcer [None req-239e3fae-95f6-43c3-8898-ef265b798c04 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 30 00:42:07.506315 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e3fae-95f6-43c3-8898-ef265b798c04 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:07.510711 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 3/5] 10.222.0.40 () {56 vars in 1207 bytes} [Sun Oct 30 00:42:07 2022] GET /identity/v3/projects/34e03b1d71cb423ba48cad74d0a6e7da => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:09.606107 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6264b09-ff60-4121-950f-3db175416309 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:09.606614 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6264b09-ff60-4121-950f-3db175416309 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:09.606694 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6264b09-ff60-4121-950f-3db175416309 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:09.611185 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 3/6] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:09.616474 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6dc01-7a77-4712-8d5b-5728275487fa None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:09.616861 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6dc01-7a77-4712-8d5b-5728275487fa None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:09.617024 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6dc01-7a77-4712-8d5b-5728275487fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:09.637410 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-81b6dc01-7a77-4712-8d5b-5728275487fa None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:09.638912 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-81b6dc01-7a77-4712-8d5b-5728275487fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:09.646677 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 4/7] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 30 00:42:09.911150 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6264b09-ff60-4121-950f-3db175416309 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:09.923596 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6264b09-ff60-4121-950f-3db175416309 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:09.927740 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75609b-c513-4c45-a71d-f19520eb42b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:09.928323 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75609b-c513-4c45-a71d-f19520eb42b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:09.928598 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75609b-c513-4c45-a71d-f19520eb42b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:09.928868 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75609b-c513-4c45-a71d-f19520eb42b0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:09.936373 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75609b-c513-4c45-a71d-f19520eb42b0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:09.938160 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75609b-c513-4c45-a71d-f19520eb42b0 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:09.946719 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 4/8] 10.222.0.40 () {58 vars in 1324 bytes} [Sun Oct 30 00:42:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 00:42:09.951803 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6dc01-7a77-4712-8d5b-5728275487fa None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:09.960802 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6dc01-7a77-4712-8d5b-5728275487fa None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:09.965156 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b4283-d341-47b4-a604-10723c249e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:09.965800 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b4283-d341-47b4-a604-10723c249e59 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:09.966080 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b4283-d341-47b4-a604-10723c249e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:09.966351 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b4283-d341-47b4-a604-10723c249e59 admin admin] PATH_INFO: `/v3/users/3d17e3752b7a4a7facf7de1b529ec751` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:09.968154 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b4283-d341-47b4-a604-10723c249e59 admin admin] RBAC: Authorizing `identity:get_user(user_id=3d17e3752b7a4a7facf7de1b529ec751)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:09.970004 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b4283-d341-47b4-a604-10723c249e59 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:09.971503 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 5/9] 10.222.0.40 () {56 vars in 1198 bytes} [Sun Oct 30 00:42:09 2022] GET /identity/v3/users/3d17e3752b7a4a7facf7de1b529ec751 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:12.152420 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65219c5d-dbfd-4701-b458-78f83054eb09 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:12.152982 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65219c5d-dbfd-4701-b458-78f83054eb09 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:12.152982 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65219c5d-dbfd-4701-b458-78f83054eb09 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:12.154336 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 5/10] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:12.159361 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087b86d-226f-445f-af6d-e90d39160878 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:12.159787 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087b86d-226f-445f-af6d-e90d39160878 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:12.160050 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087b86d-226f-445f-af6d-e90d39160878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:12.177810 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-3087b86d-226f-445f-af6d-e90d39160878 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:12.178981 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3087b86d-226f-445f-af6d-e90d39160878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:12.195131 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4d46f-ff12-4490-aa72-8b03ebdffb1c None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:12.195416 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4d46f-ff12-4490-aa72-8b03ebdffb1c None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:12.195693 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4d46f-ff12-4490-aa72-8b03ebdffb1c None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:12.196990 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 6/11] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:42:12.202917 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc853d6-64af-43b7-ab9f-ddf261b9a2c4 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:12.203197 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc853d6-64af-43b7-ab9f-ddf261b9a2c4 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:12.203466 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc853d6-64af-43b7-ab9f-ddf261b9a2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:12.243641 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG passlib.handlers.bcrypt [None req-8cc853d6-64af-43b7-ab9f-ddf261b9a2c4 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81352) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 30 00:42:12.244027 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG passlib.handlers.bcrypt [None req-8cc853d6-64af-43b7-ab9f-ddf261b9a2c4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81352) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 30 00:42:12.260589 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 6/12] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:42:12.293994 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-8cc853d6-64af-43b7-ab9f-ddf261b9a2c4 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:12.295589 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8cc853d6-64af-43b7-ab9f-ddf261b9a2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:12.393509 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 7/13] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:42:12.529855 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087b86d-226f-445f-af6d-e90d39160878 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:12.553836 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:12.631983 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087b86d-226f-445f-af6d-e90d39160878 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:12.661324 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc853d6-64af-43b7-ab9f-ddf261b9a2c4 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:12.666265 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e3698-969b-4f81-8752-041980b16c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:12.666907 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e3698-969b-4f81-8752-041980b16c96 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:12.667184 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e3698-969b-4f81-8752-041980b16c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:12.667456 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e3698-969b-4f81-8752-041980b16c96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:12.679524 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e3698-969b-4f81-8752-041980b16c96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:42:12.688940 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-737e3698-969b-4f81-8752-041980b16c96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:42:12.688940 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:12.688940 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:42:12.688940 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:42:12.688940 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:42:12.688940 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:42:12.688940 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:42:12.688940 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:42:12.688940 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:42:12.688940 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:42:12.688940 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:42:12.688940 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:42:12.688940 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:42:12.688940 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:42:12.688940 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:42:12.688940 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:42:12.690058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:42:12.690058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:42:12.690058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:42:12.690058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:42:12.690058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:42:12.690058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:42:12.690058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:42:12.690058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:42:12.690058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:42:12.690058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:42:12.690058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:42:12.690058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:42:12.690058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:42:12.690058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:42:12.690058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:42:12.690058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:42:12.690912 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:42:12.690912 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:42:12.690912 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:42:12.690912 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:42:12.690912 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:42:12.690912 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:42:12.690912 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:42:12.690912 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:42:12.690912 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:42:12.690912 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:42:12.690912 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:42:12.690912 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:42:12.690912 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 7/14] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Oct 30 00:42:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:42:12.695734 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e3698-969b-4f81-8752-041980b16c96 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:12.761904 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc853d6-64af-43b7-ab9f-ddf261b9a2c4 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:12.764193 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:12.774233 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:12.793814 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e3698-969b-4f81-8752-041980b16c96 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:12.799932 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d330b-b712-49bd-ba8c-54e460e7cf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:12.800779 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d330b-b712-49bd-ba8c-54e460e7cf39 None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:12.801053 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d330b-b712-49bd-ba8c-54e460e7cf39 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:12.801349 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d330b-b712-49bd-ba8c-54e460e7cf39 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:12.802303 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d330b-b712-49bd-ba8c-54e460e7cf39 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:12.803725 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d330b-b712-49bd-ba8c-54e460e7cf39 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:12.814995 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.sql.core [None req-342d330b-b712-49bd-ba8c-54e460e7cf39 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 30 00:42:12.814995 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 30 00:42:12.814995 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [parameters: {'id': 'd3d974827fb34acfb9621db6fdd48497', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 30 00:42:12.814995 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81352) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 30 00:42:12.827524 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7838b-dc3f-4887-8c98-e1d4ef63783c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:12.828127 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7838b-dc3f-4887-8c98-e1d4ef63783c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:12.828408 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7838b-dc3f-4887-8c98-e1d4ef63783c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:12.828682 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7838b-dc3f-4887-8c98-e1d4ef63783c None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:12.829376 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d7838b-dc3f-4887-8c98-e1d4ef63783c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:12.829678 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d7838b-dc3f-4887-8c98-e1d4ef63783c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:12.831056 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d7838b-dc3f-4887-8c98-e1d4ef63783c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:12.833033 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-342d330b-b712-49bd-ba8c-54e460e7cf39 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 30 00:42:12.833033 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:12.833033 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 00:42:12.833033 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 00:42:12.833033 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 00:42:12.833033 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 00:42:12.833033 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 00:42:12.833033 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 00:42:12.833033 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 00:42:12.833033 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application conn.query(q) Oct 30 00:42:12.833033 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 00:42:12.833033 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 00:42:12.833033 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 00:42:12.833033 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application result.read() Oct 30 00:42:12.833860 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 00:42:12.833860 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 00:42:12.833860 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 00:42:12.833860 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 00:42:12.833860 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 00:42:12.833860 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 00:42:12.833860 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 00:42:12.833860 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 00:42:12.833860 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 30 00:42:12.833860 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:42:12.833860 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 30 00:42:12.833860 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:42:12.833860 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:12.833860 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 30 00:42:12.833860 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 30 00:42:12.833860 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 30 00:42:12.833860 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 30 00:42:12.833860 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 00:42:12.834802 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application next(self.gen) Oct 30 00:42:12.834802 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 30 00:42:12.834802 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application yield resource Oct 30 00:42:12.834802 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 00:42:12.834802 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application next(self.gen) Oct 30 00:42:12.834802 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 30 00:42:12.834802 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self.session.rollback() Oct 30 00:42:12.834802 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 00:42:12.834802 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self.force_reraise() Oct 30 00:42:12.834802 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 00:42:12.834802 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise self.value Oct 30 00:42:12.834802 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 30 00:42:12.834802 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 30 00:42:12.834802 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 30 00:42:12.834802 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application session.commit() Oct 30 00:42:12.834802 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 30 00:42:12.834802 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 30 00:42:12.835661 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 30 00:42:12.835661 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._prepare_impl() Oct 30 00:42:12.835661 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 30 00:42:12.835661 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self.session.flush() Oct 30 00:42:12.835661 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 30 00:42:12.835661 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._flush(objects) Oct 30 00:42:12.835661 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 30 00:42:12.835661 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 30 00:42:12.835661 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 30 00:42:12.835661 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application compat.raise_( Oct 30 00:42:12.835661 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 00:42:12.835661 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception Oct 30 00:42:12.835661 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 30 00:42:12.835661 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application flush_context.execute() Oct 30 00:42:12.835661 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 30 00:42:12.835661 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rec.execute(self) Oct 30 00:42:12.835661 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 30 00:42:12.836560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 30 00:42:12.836560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 30 00:42:12.836560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 30 00:42:12.836560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 30 00:42:12.836560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 30 00:42:12.836560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 30 00:42:12.836560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 30 00:42:12.836560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 30 00:42:12.836560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 30 00:42:12.836560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 30 00:42:12.836560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 30 00:42:12.836560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 30 00:42:12.836560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 30 00:42:12.836560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 30 00:42:12.836560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 30 00:42:12.837406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 00:42:12.837406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception Oct 30 00:42:12.837406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 00:42:12.837406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 00:42:12.837406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 00:42:12.837406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 00:42:12.837406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 00:42:12.837406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 00:42:12.837406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 00:42:12.837406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application conn.query(q) Oct 30 00:42:12.837406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 00:42:12.837406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 00:42:12.837406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 00:42:12.837406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application result.read() Oct 30 00:42:12.837406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 00:42:12.837406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 00:42:12.837406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 00:42:12.838196 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 00:42:12.838196 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 00:42:12.838196 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 00:42:12.838196 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 00:42:12.838196 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 00:42:12.838196 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 30 00:42:12.838196 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 30 00:42:12.838196 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [parameters: {'id': 'd3d974827fb34acfb9621db6fdd48497', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 30 00:42:12.838196 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 30 00:42:12.838196 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:42:12.838196 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:42:12.838196 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:42:12.838196 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:12.838196 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 30 00:42:12.838196 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 30 00:42:12.839179 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 30 00:42:12.839179 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 30 00:42:12.839179 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 30 00:42:12.839179 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:42:12.839179 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:42:12.839179 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:42:12.839179 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:12.839179 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:42:12.839179 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:42:12.839179 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:42:12.839179 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:42:12.839179 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:42:12.839179 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:42:12.839179 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:42:12.839179 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:42:12.839179 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:42:12.839179 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:42:12.840500 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 30 00:42:12.840500 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 30 00:42:12.840500 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:42:12.840500 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:42:12.840500 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 30 00:42:12.840500 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 30 00:42:12.840500 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:42:12.840500 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:42:12.840500 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 30 00:42:12.840500 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 30 00:42:12.840500 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 30 00:42:12.840500 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:42:12.840500 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 8/15] 10.222.0.40 () {60 vars in 1137 bytes} [Sun Oct 30 00:42:12 2022] POST /identity/v3/domains => generated 190 bytes in 173 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:42:12.840500 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d330b-b712-49bd-ba8c-54e460e7cf39 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:12.848072 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 8/16] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:42:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:42:12.853601 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7838b-dc3f-4887-8c98-e1d4ef63783c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:12.940470 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d330b-b712-49bd-ba8c-54e460e7cf39 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:12.952416 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7838b-dc3f-4887-8c98-e1d4ef63783c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:12.973261 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e442e-c98d-4a82-8f10-cc32aeaec0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:12.974094 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e442e-c98d-4a82-8f10-cc32aeaec0ba None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:12.974370 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e442e-c98d-4a82-8f10-cc32aeaec0ba None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:12.974642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e442e-c98d-4a82-8f10-cc32aeaec0ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:12.985815 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9741e05-fd6d-4f01-9dbd-1f2e39f2f081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:12.986436 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9741e05-fd6d-4f01-9dbd-1f2e39f2f081 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:12.986715 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9741e05-fd6d-4f01-9dbd-1f2e39f2f081 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:12.986991 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9741e05-fd6d-4f01-9dbd-1f2e39f2f081 None admin] PATH_INFO: `/v3/users/3d17e3752b7a4a7facf7de1b529ec751` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:12.988114 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9741e05-fd6d-4f01-9dbd-1f2e39f2f081 None admin] RBAC: Authorizing `identity:get_user(user_id=3d17e3752b7a4a7facf7de1b529ec751)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:12.989588 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9741e05-fd6d-4f01-9dbd-1f2e39f2f081 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:12.991142 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 9/17] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:42:12 2022] GET /identity/v3/users/3d17e3752b7a4a7facf7de1b529ec751 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:42:12.993223 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e442e-c98d-4a82-8f10-cc32aeaec0ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:12.994670 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e442e-c98d-4a82-8f10-cc32aeaec0ba None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:12.996546 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9741e05-fd6d-4f01-9dbd-1f2e39f2f081 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:13.010360 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-fd1e442e-c98d-4a82-8f10-cc32aeaec0ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:42:13.010360 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:13.010360 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:42:13.010360 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:42:13.010360 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:42:13.010360 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:42:13.010360 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:42:13.010360 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:42:13.010360 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:42:13.010360 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:42:13.010360 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:42:13.010360 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:42:13.010360 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:42:13.010360 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:42:13.010360 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:42:13.010360 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:42:13.011443 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:42:13.011443 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:42:13.011443 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:42:13.011443 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:42:13.011443 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:42:13.011443 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:42:13.011443 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:42:13.011443 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:42:13.011443 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:42:13.011443 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:42:13.011443 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:42:13.011443 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:42:13.011443 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:42:13.011443 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:42:13.011443 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:42:13.011443 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:42:13.011443 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:42:13.012667 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:42:13.012667 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:42:13.012667 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:42:13.012667 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 9/18] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:42:13.013099 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:13.017252 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e442e-c98d-4a82-8f10-cc32aeaec0ba None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:13.039263 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:13.098760 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9741e05-fd6d-4f01-9dbd-1f2e39f2f081 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:13.120914 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e442e-c98d-4a82-8f10-cc32aeaec0ba None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:13.131864 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6de2e-b460-4a1d-b21d-a2357eeb6572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:13.132495 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6de2e-b460-4a1d-b21d-a2357eeb6572 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:13.132774 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6de2e-b460-4a1d-b21d-a2357eeb6572 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:13.133045 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6de2e-b460-4a1d-b21d-a2357eeb6572 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:13.134180 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6de2e-b460-4a1d-b21d-a2357eeb6572 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:13.135644 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6de2e-b460-4a1d-b21d-a2357eeb6572 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:13.137212 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 10/19] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:42:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:42:13.143288 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6de2e-b460-4a1d-b21d-a2357eeb6572 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:13.157006 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c635120-cbdc-4dd0-9ef9-c15d17fc23f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:13.157650 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c635120-cbdc-4dd0-9ef9-c15d17fc23f7 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:13.157925 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c635120-cbdc-4dd0-9ef9-c15d17fc23f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:13.158195 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c635120-cbdc-4dd0-9ef9-c15d17fc23f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:13.158821 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c635120-cbdc-4dd0-9ef9-c15d17fc23f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:13.159117 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c635120-cbdc-4dd0-9ef9-c15d17fc23f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:13.160501 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c635120-cbdc-4dd0-9ef9-c15d17fc23f7 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:13.177038 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 10/20] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:42:13.225027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:13.245993 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6de2e-b460-4a1d-b21d-a2357eeb6572 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:13.282097 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71afcac6-73f6-4370-a074-f6c497c12e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:13.282764 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afcac6-73f6-4370-a074-f6c497c12e25 None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:13.283043 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afcac6-73f6-4370-a074-f6c497c12e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:13.283320 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afcac6-73f6-4370-a074-f6c497c12e25 None admin] PATH_INFO: `/v3/domains/default/users/3d17e3752b7a4a7facf7de1b529ec751/roles/17d0330d6df84d3091d7ef234dfc4e6b` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:13.285311 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71afcac6-73f6-4370-a074-f6c497c12e25 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3d17e3752b7a4a7facf7de1b529ec751, role_id=17d0330d6df84d3091d7ef234dfc4e6b)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:13.286791 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71afcac6-73f6-4370-a074-f6c497c12e25 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:13.402167 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 11/21] 10.222.0.40 () {58 vars in 1361 bytes} [Sun Oct 30 00:42:13 2022] PUT /identity/v3/domains/default/users/3d17e3752b7a4a7facf7de1b529ec751/roles/17d0330d6df84d3091d7ef234dfc4e6b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:42:15.828652 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13378f1-b259-4b9a-8011-756a755a9f2b None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:15.829168 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13378f1-b259-4b9a-8011-756a755a9f2b None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:15.829168 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13378f1-b259-4b9a-8011-756a755a9f2b None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:15.830841 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 11/22] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:15.836625 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540350a0-1394-4d0e-bfda-1de7c2ac6641 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:15.837025 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540350a0-1394-4d0e-bfda-1de7c2ac6641 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:15.837235 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540350a0-1394-4d0e-bfda-1de7c2ac6641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:15.861768 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-540350a0-1394-4d0e-bfda-1de7c2ac6641 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:15.863488 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-540350a0-1394-4d0e-bfda-1de7c2ac6641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:15.905958 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f01fd0-7092-413f-997b-7efdc20cba68 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:15.906260 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f01fd0-7092-413f-997b-7efdc20cba68 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:15.906508 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f01fd0-7092-413f-997b-7efdc20cba68 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:15.907826 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 12/23] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:15.913551 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3a13e-b206-4ba5-94d9-98426f74395c None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:15.913813 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3a13e-b206-4ba5-94d9-98426f74395c None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:15.914092 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3a13e-b206-4ba5-94d9-98426f74395c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:15.953314 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-34b3a13e-b206-4ba5-94d9-98426f74395c None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:15.953314 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-34b3a13e-b206-4ba5-94d9-98426f74395c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:15.966786 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 12/24] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:42:16.008134 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde031e6-c021-4178-9815-ba6985664afc None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:16.008542 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde031e6-c021-4178-9815-ba6985664afc None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:16.008900 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde031e6-c021-4178-9815-ba6985664afc None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:16.013134 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 13/25] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:42:16.049546 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ca3d8-1620-4480-af76-ec431531dfe7 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:16.049877 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ca3d8-1620-4480-af76-ec431531dfe7 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:16.050099 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ca3d8-1620-4480-af76-ec431531dfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:16.060371 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 13/26] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:42:16.086514 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-4c4ca3d8-1620-4480-af76-ec431531dfe7 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:16.087757 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4c4ca3d8-1620-4480-af76-ec431531dfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:16.180100 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:16.184675 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 14/27] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:42:16.417959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3a13e-b206-4ba5-94d9-98426f74395c None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:16.418308 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ca3d8-1620-4480-af76-ec431531dfe7 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:16.435123 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:16.593328 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ca3d8-1620-4480-af76-ec431531dfe7 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:16.630019 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3a13e-b206-4ba5-94d9-98426f74395c None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:16.661754 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474192b3-32fd-4329-9aca-8844f260c37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:16.662411 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474192b3-32fd-4329-9aca-8844f260c37f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:16.662693 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474192b3-32fd-4329-9aca-8844f260c37f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:16.662964 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474192b3-32fd-4329-9aca-8844f260c37f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:16.691116 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474192b3-32fd-4329-9aca-8844f260c37f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:16.692724 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474192b3-32fd-4329-9aca-8844f260c37f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:16.717962 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f159a3-bf08-48ca-bbfc-d62549b64afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:16.718597 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f159a3-bf08-48ca-bbfc-d62549b64afb None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:16.718901 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f159a3-bf08-48ca-bbfc-d62549b64afb None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:16.719131 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f159a3-bf08-48ca-bbfc-d62549b64afb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:16.720342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-474192b3-32fd-4329-9aca-8844f260c37f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:42:16.720342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:16.720342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:42:16.720342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:42:16.720342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:42:16.720342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:42:16.720342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:42:16.720342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:42:16.720342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:42:16.720342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:42:16.720342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:42:16.720342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:42:16.720342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:42:16.720342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:42:16.720342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:42:16.720342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:42:16.721168 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:42:16.721168 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:42:16.721168 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:42:16.721168 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:42:16.721168 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:42:16.721168 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:42:16.721168 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:42:16.721168 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:42:16.721168 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:42:16.721168 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:42:16.721168 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:42:16.721168 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:42:16.721168 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:42:16.721168 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:42:16.721168 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:42:16.721168 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:42:16.721168 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:42:16.721986 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:42:16.721986 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:42:16.721986 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:42:16.721986 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 15/28] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:42:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:42:16.728316 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474192b3-32fd-4329-9aca-8844f260c37f None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:16.750163 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f159a3-bf08-48ca-bbfc-d62549b64afb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:42:16.756598 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-46f159a3-bf08-48ca-bbfc-d62549b64afb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:42:16.756598 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:16.756598 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:42:16.756598 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:42:16.756598 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:42:16.756598 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:42:16.756598 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:42:16.756598 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:42:16.756598 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:42:16.756598 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:42:16.756598 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:42:16.756598 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:42:16.756598 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:42:16.756598 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:42:16.756598 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:42:16.756598 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:42:16.757545 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:42:16.757545 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:42:16.757545 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:42:16.757545 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:42:16.757545 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:42:16.757545 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:42:16.757545 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:42:16.757545 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:42:16.757545 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:42:16.757545 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:42:16.757545 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:42:16.757545 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:42:16.757545 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:42:16.757545 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:42:16.757545 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:42:16.757545 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:42:16.758303 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:42:16.758303 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:42:16.758303 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:42:16.758303 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:42:16.758303 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:42:16.758303 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:42:16.758303 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:42:16.758303 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:42:16.758303 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:42:16.758303 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:42:16.758303 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:42:16.758303 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:42:16.758303 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 14/29] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Oct 30 00:42:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:42:16.768235 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f159a3-bf08-48ca-bbfc-d62549b64afb None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:16.821656 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:16.862575 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:16.886986 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474192b3-32fd-4329-9aca-8844f260c37f None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:16.902948 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f159a3-bf08-48ca-bbfc-d62549b64afb None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:16.927108 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1f5ad-226b-4f46-9e4b-ae2d34bf462d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:16.927824 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1f5ad-226b-4f46-9e4b-ae2d34bf462d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:16.928319 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1f5ad-226b-4f46-9e4b-ae2d34bf462d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:16.928906 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1f5ad-226b-4f46-9e4b-ae2d34bf462d None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:16.929796 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1f5ad-226b-4f46-9e4b-ae2d34bf462d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:16.930305 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1f5ad-226b-4f46-9e4b-ae2d34bf462d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:16.931965 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1f5ad-226b-4f46-9e4b-ae2d34bf462d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:16.948250 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5eadf9-e3c0-405d-8962-7d42ddbe576e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:16.949125 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5eadf9-e3c0-405d-8962-7d42ddbe576e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:16.949668 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5eadf9-e3c0-405d-8962-7d42ddbe576e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:16.950103 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5eadf9-e3c0-405d-8962-7d42ddbe576e None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:16.950951 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5eadf9-e3c0-405d-8962-7d42ddbe576e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:16.951196 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 16/30] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:42:16.951655 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5eadf9-e3c0-405d-8962-7d42ddbe576e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:16.952116 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1f5ad-226b-4f46-9e4b-ae2d34bf462d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:16.953537 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5eadf9-e3c0-405d-8962-7d42ddbe576e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:16.967070 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 15/31] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:42:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:16.968575 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0892abd-8c4c-4fff-b723-75c38e3fa541 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:16.969125 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0892abd-8c4c-4fff-b723-75c38e3fa541 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:16.969609 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0892abd-8c4c-4fff-b723-75c38e3fa541 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:16.971293 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 16/32] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:16.976280 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0892abd-8c4c-4fff-b723-75c38e3fa541 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:17.068683 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1f5ad-226b-4f46-9e4b-ae2d34bf462d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:17.080561 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0892abd-8c4c-4fff-b723-75c38e3fa541 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:17.082819 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:17.108612 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae302ef8-6291-4ca1-8a7b-1ea3411c08c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:17.109476 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae302ef8-6291-4ca1-8a7b-1ea3411c08c1 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:17.109767 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae302ef8-6291-4ca1-8a7b-1ea3411c08c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:17.110032 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae302ef8-6291-4ca1-8a7b-1ea3411c08c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:17.110831 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae302ef8-6291-4ca1-8a7b-1ea3411c08c1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:17.112231 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae302ef8-6291-4ca1-8a7b-1ea3411c08c1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:17.113476 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:17.119146 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bcec5e-14b1-47a3-90d7-71b2e1470a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:17.119753 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcec5e-14b1-47a3-90d7-71b2e1470a2b None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:17.120030 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcec5e-14b1-47a3-90d7-71b2e1470a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:17.120294 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcec5e-14b1-47a3-90d7-71b2e1470a2b None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:17.120928 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bcec5e-14b1-47a3-90d7-71b2e1470a2b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:17.122397 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bcec5e-14b1-47a3-90d7-71b2e1470a2b None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:17.132535 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 17/33] 10.222.0.40 () {60 vars in 1131 bytes} [Sun Oct 30 00:42:16 2022] POST /identity/v3/roles => generated 219 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:42:17.133471 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae302ef8-6291-4ca1-8a7b-1ea3411c08c1 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:17.268872 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae302ef8-6291-4ca1-8a7b-1ea3411c08c1 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:17.270954 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 17/34] 10.222.0.40 () {60 vars in 1141 bytes} [Sun Oct 30 00:42:16 2022] POST /identity/v3/projects => generated 301 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:42:17.272982 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d6efc-f02d-44ed-848a-4472796cb4ea None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:17.272982 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d6efc-f02d-44ed-848a-4472796cb4ea None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:17.272982 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d6efc-f02d-44ed-848a-4472796cb4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:17.293104 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-297d6efc-f02d-44ed-848a-4472796cb4ea None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:17.294764 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-297d6efc-f02d-44ed-848a-4472796cb4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:17.320705 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2522ec-262e-4dfb-8f88-af6ddbfe635e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:17.322014 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2522ec-262e-4dfb-8f88-af6ddbfe635e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:17.322546 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2522ec-262e-4dfb-8f88-af6ddbfe635e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:17.323462 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2522ec-262e-4dfb-8f88-af6ddbfe635e None admin] PATH_INFO: `/v3/users/3d17e3752b7a4a7facf7de1b529ec751` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:17.325433 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2522ec-262e-4dfb-8f88-af6ddbfe635e None admin] RBAC: Authorizing `identity:get_user(user_id=3d17e3752b7a4a7facf7de1b529ec751)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:17.327281 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2522ec-262e-4dfb-8f88-af6ddbfe635e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:17.329329 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 18/35] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:42:17 2022] GET /identity/v3/users/3d17e3752b7a4a7facf7de1b529ec751 => generated 247 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:17.331779 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b766bd-e67d-49ac-930c-0512410090a6 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:17.332321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b766bd-e67d-49ac-930c-0512410090a6 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:17.332789 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b766bd-e67d-49ac-930c-0512410090a6 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:17.335003 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 19/36] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:17.336257 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b766bd-e67d-49ac-930c-0512410090a6 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:17.392205 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 18/37] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:42:17.393676 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1a3fe-fe43-44c3-a21f-4f3df837d0ce None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:17.393968 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1a3fe-fe43-44c3-a21f-4f3df837d0ce None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:17.394244 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1a3fe-fe43-44c3-a21f-4f3df837d0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:17.396288 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:17.415507 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-3bb1a3fe-fe43-44c3-a21f-4f3df837d0ce None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:17.416898 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-3bb1a3fe-fe43-44c3-a21f-4f3df837d0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:17.467951 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b766bd-e67d-49ac-930c-0512410090a6 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:17.497070 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 19/38] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:42:17.509288 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be67e1-0ceb-41b7-9704-0c99326ae53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:17.510286 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be67e1-0ceb-41b7-9704-0c99326ae53e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:17.510790 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be67e1-0ceb-41b7-9704-0c99326ae53e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:17.511266 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be67e1-0ceb-41b7-9704-0c99326ae53e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:17.512681 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be67e1-0ceb-41b7-9704-0c99326ae53e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:17.514459 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be67e1-0ceb-41b7-9704-0c99326ae53e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:17.516328 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 20/39] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:42:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:17.522638 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1a3fe-fe43-44c3-a21f-4f3df837d0ce None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:17.584223 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:17.612505 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ef9da-28eb-4f66-8092-b2ed86954946 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:17.613092 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ef9da-28eb-4f66-8092-b2ed86954946 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:17.613413 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ef9da-28eb-4f66-8092-b2ed86954946 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:17.614927 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 21/40] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:17.620457 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda863ea-54cc-41cb-946a-021424911a99 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:17.620716 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda863ea-54cc-41cb-946a-021424911a99 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:17.620989 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda863ea-54cc-41cb-946a-021424911a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:17.644476 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1a3fe-fe43-44c3-a21f-4f3df837d0ce None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:17.647806 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-cda863ea-54cc-41cb-946a-021424911a99 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:17.649299 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-cda863ea-54cc-41cb-946a-021424911a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:17.680036 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd8bb9-52c2-428b-8d9d-8c0aeba15868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:17.680650 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd8bb9-52c2-428b-8d9d-8c0aeba15868 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:17.680955 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd8bb9-52c2-428b-8d9d-8c0aeba15868 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:17.681330 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd8bb9-52c2-428b-8d9d-8c0aeba15868 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:17.682157 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd8bb9-52c2-428b-8d9d-8c0aeba15868 None admin] RBAC: Adding query filter params (role.id=17d0330d6df84d3091d7ef234dfc4e6b, scope.domain.id=default, user.id=3d17e3752b7a4a7facf7de1b529ec751) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:17.682472 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd8bb9-52c2-428b-8d9d-8c0aeba15868 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:17.684036 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd8bb9-52c2-428b-8d9d-8c0aeba15868 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:17.693225 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 20/41] 10.222.0.40 () {56 vars in 1322 bytes} [Sun Oct 30 00:42:17 2022] GET /identity/v3/role_assignments?user.id=3d17e3752b7a4a7facf7de1b529ec751&scope.domain.id=default&role.id=17d0330d6df84d3091d7ef234dfc4e6b => generated 530 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:17.787256 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd8bb9-52c2-428b-8d9d-8c0aeba15868 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:17.837667 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 22/42] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:42:17.890581 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda863ea-54cc-41cb-946a-021424911a99 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:17.930601 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd8bb9-52c2-428b-8d9d-8c0aeba15868 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:17.936824 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:17.944794 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:17.975526 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441a10e-bad5-4b95-bd61-ca76d618b09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:17.976339 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441a10e-bad5-4b95-bd61-ca76d618b09c None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:17.976774 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441a10e-bad5-4b95-bd61-ca76d618b09c None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:17.977183 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441a10e-bad5-4b95-bd61-ca76d618b09c None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:17.978070 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441a10e-bad5-4b95-bd61-ca76d618b09c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:17.980585 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441a10e-bad5-4b95-bd61-ca76d618b09c None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:17.999546 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 21/43] 10.222.0.40 () {60 vars in 1131 bytes} [Sun Oct 30 00:42:17 2022] POST /identity/v3/roles => generated 225 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:42:18.011499 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda863ea-54cc-41cb-946a-021424911a99 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:18.051102 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cb75e-8d83-4f63-a9ed-6951c7271784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:18.051644 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cb75e-8d83-4f63-a9ed-6951c7271784 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:18.051922 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cb75e-8d83-4f63-a9ed-6951c7271784 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:18.052193 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cb75e-8d83-4f63-a9ed-6951c7271784 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:18.052876 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cb75e-8d83-4f63-a9ed-6951c7271784 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:18.054353 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cb75e-8d83-4f63-a9ed-6951c7271784 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:18.070960 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 23/44] 10.222.0.40 () {60 vars in 1131 bytes} [Sun Oct 30 00:42:17 2022] POST /identity/v3/roles => generated 223 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:42:18.118960 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441a10e-bad5-4b95-bd61-ca76d618b09c None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:18.239949 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441a10e-bad5-4b95-bd61-ca76d618b09c None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:18.274774 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8297c9-43c6-4626-8a66-e816a740dc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:18.275399 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8297c9-43c6-4626-8a66-e816a740dc8c None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:18.275678 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8297c9-43c6-4626-8a66-e816a740dc8c None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:18.275946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8297c9-43c6-4626-8a66-e816a740dc8c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:18.277044 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8297c9-43c6-4626-8a66-e816a740dc8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:18.278523 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8297c9-43c6-4626-8a66-e816a740dc8c None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:18.280594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 22/45] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:42:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:18.286380 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cb75e-8d83-4f63-a9ed-6951c7271784 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:18.381266 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:18.385051 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cb75e-8d83-4f63-a9ed-6951c7271784 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:18.420714 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178252f-5a4f-4f11-af15-f463842012e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:18.421359 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178252f-5a4f-4f11-af15-f463842012e8 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:18.421651 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178252f-5a4f-4f11-af15-f463842012e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:18.421924 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178252f-5a4f-4f11-af15-f463842012e8 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:18.422564 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0178252f-5a4f-4f11-af15-f463842012e8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:18.423997 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0178252f-5a4f-4f11-af15-f463842012e8 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:18.450596 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 24/46] 10.222.0.40 () {60 vars in 1141 bytes} [Sun Oct 30 00:42:18 2022] POST /identity/v3/projects => generated 312 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:42:20.549207 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0a0f9-1c50-41a6-8064-717e48bacbae None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:20.549726 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0a0f9-1c50-41a6-8064-717e48bacbae None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:20.549807 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0a0f9-1c50-41a6-8064-717e48bacbae None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:20.551087 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 23/47] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:20.556182 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f8424-07b4-433c-bc14-3ebb65140611 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:20.556612 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f8424-07b4-433c-bc14-3ebb65140611 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:20.556740 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f8424-07b4-433c-bc14-3ebb65140611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:20.574416 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-7e4f8424-07b4-433c-bc14-3ebb65140611 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:20.575615 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7e4f8424-07b4-433c-bc14-3ebb65140611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:20.642628 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 25/48] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:42:20.911684 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0a0f9-1c50-41a6-8064-717e48bacbae None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:20.947968 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:21.011150 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0a0f9-1c50-41a6-8064-717e48bacbae None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:21.043437 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4b0e1-6197-46a1-b98c-2aaa9f961804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:21.044050 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4b0e1-6197-46a1-b98c-2aaa9f961804 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:21.044327 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4b0e1-6197-46a1-b98c-2aaa9f961804 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:21.045147 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4b0e1-6197-46a1-b98c-2aaa9f961804 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:21.046256 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4b0e1-6197-46a1-b98c-2aaa9f961804 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:21.047701 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4b0e1-6197-46a1-b98c-2aaa9f961804 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:21.049251 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 24/49] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:42:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:21.054789 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f8424-07b4-433c-bc14-3ebb65140611 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:21.130798 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:21.150873 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f8424-07b4-433c-bc14-3ebb65140611 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:21.184253 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817f97a-413a-4d74-9b70-fef8701ef9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:21.184784 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817f97a-413a-4d74-9b70-fef8701ef9ea None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:21.185057 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817f97a-413a-4d74-9b70-fef8701ef9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:21.185352 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817f97a-413a-4d74-9b70-fef8701ef9ea None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:21.185995 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817f97a-413a-4d74-9b70-fef8701ef9ea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:21.187441 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817f97a-413a-4d74-9b70-fef8701ef9ea None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:21.211887 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 26/50] 10.222.0.40 () {60 vars in 1140 bytes} [Sun Oct 30 00:42:21 2022] POST /identity/v3/projects => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:42:23.334194 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0875f-6a1b-48d7-85b4-75630f0881d9 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:23.334702 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0875f-6a1b-48d7-85b4-75630f0881d9 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:23.334783 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0875f-6a1b-48d7-85b4-75630f0881d9 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:23.336051 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 25/51] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:23.341333 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e0c05-5825-489c-85aa-c71709c75c35 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:23.341737 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e0c05-5825-489c-85aa-c71709c75c35 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:23.341888 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e0c05-5825-489c-85aa-c71709c75c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:23.359719 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-cb8e0c05-5825-489c-85aa-c71709c75c35 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:23.360895 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-cb8e0c05-5825-489c-85aa-c71709c75c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:23.425651 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 27/52] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:42:23.690899 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0875f-6a1b-48d7-85b4-75630f0881d9 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:23.789403 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0875f-6a1b-48d7-85b4-75630f0881d9 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:23.791610 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:23.821680 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9018b-0a13-4279-9778-e46d24dead5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:23.822294 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9018b-0a13-4279-9778-e46d24dead5b None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:23.822572 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9018b-0a13-4279-9778-e46d24dead5b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:23.822843 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9018b-0a13-4279-9778-e46d24dead5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:23.823932 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9018b-0a13-4279-9778-e46d24dead5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:23.825415 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9018b-0a13-4279-9778-e46d24dead5b None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:23.827422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 26/53] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:42:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:23.832952 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e0c05-5825-489c-85aa-c71709c75c35 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:23.891687 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:23.930275 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e0c05-5825-489c-85aa-c71709c75c35 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:23.962864 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085cd68-3952-4804-92e9-c3c7f8d9ad66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:23.963461 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085cd68-3952-4804-92e9-c3c7f8d9ad66 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:23.963743 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085cd68-3952-4804-92e9-c3c7f8d9ad66 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:23.964016 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085cd68-3952-4804-92e9-c3c7f8d9ad66 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:23.964666 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085cd68-3952-4804-92e9-c3c7f8d9ad66 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:23.966143 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085cd68-3952-4804-92e9-c3c7f8d9ad66 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:23.992427 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 28/54] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Oct 30 00:42:23 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:42:27.186020 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcd97c-e38c-4eb4-986b-315f35281388 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:27.186566 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcd97c-e38c-4eb4-986b-315f35281388 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:27.186566 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcd97c-e38c-4eb4-986b-315f35281388 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:27.188093 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 27/55] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:27.193378 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd36320-aa61-4a11-9101-5b8227018599 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:27.193784 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd36320-aa61-4a11-9101-5b8227018599 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:27.193975 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd36320-aa61-4a11-9101-5b8227018599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:27.218175 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-6fd36320-aa61-4a11-9101-5b8227018599 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:27.219383 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6fd36320-aa61-4a11-9101-5b8227018599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:27.309586 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 29/56] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:42:27.473256 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af259b8-e391-4590-a857-96f64d5e6f59 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:27.473555 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af259b8-e391-4590-a857-96f64d5e6f59 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:27.473732 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af259b8-e391-4590-a857-96f64d5e6f59 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:27.475083 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 28/57] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:27.480207 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477e3cd-c8ea-4519-913a-48a2d98f9e7f None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:27.480499 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477e3cd-c8ea-4519-913a-48a2d98f9e7f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:27.480774 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477e3cd-c8ea-4519-913a-48a2d98f9e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:27.509316 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-6477e3cd-c8ea-4519-913a-48a2d98f9e7f None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:27.510492 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6477e3cd-c8ea-4519-913a-48a2d98f9e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:27.567362 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:27.606832 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 30/58] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:42:27.620103 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04341630-8ae2-4ce9-b3d8-b1e282509ff4 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:27.620435 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04341630-8ae2-4ce9-b3d8-b1e282509ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:27.620658 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04341630-8ae2-4ce9-b3d8-b1e282509ff4 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:27.622399 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 29/59] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:27.628299 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d756a-bdae-4f48-9121-dce4d9a66e74 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:27.628585 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d756a-bdae-4f48-9121-dce4d9a66e74 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:27.628858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d756a-bdae-4f48-9121-dce4d9a66e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:27.658172 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-754d756a-bdae-4f48-9121-dce4d9a66e74 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:27.659361 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-754d756a-bdae-4f48-9121-dce4d9a66e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:27.720162 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04341630-8ae2-4ce9-b3d8-b1e282509ff4 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:27.768113 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 31/60] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:42:27.770069 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9bdb5-051d-4e8b-a701-347f8c58a9ff None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:27.770561 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9bdb5-051d-4e8b-a701-347f8c58a9ff None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:27.771038 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9bdb5-051d-4e8b-a701-347f8c58a9ff None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:27.772477 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 32/61] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:27.779435 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ac09b-0e64-437f-8b39-4c623544d8fb None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:27.779435 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ac09b-0e64-437f-8b39-4c623544d8fb None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:27.779435 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ac09b-0e64-437f-8b39-4c623544d8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:27.796646 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-192ac09b-0e64-437f-8b39-4c623544d8fb None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:27.797878 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-192ac09b-0e64-437f-8b39-4c623544d8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:27.894972 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 33/62] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:42:27.898093 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb4fb8-bd33-4f14-83bf-a8d65e1d3b94 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:27.898709 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb4fb8-bd33-4f14-83bf-a8d65e1d3b94 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:27.899001 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb4fb8-bd33-4f14-83bf-a8d65e1d3b94 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:27.901296 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 34/63] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:27.901296 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb4fb8-bd33-4f14-83bf-a8d65e1d3b94 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:27.914824 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04341630-8ae2-4ce9-b3d8-b1e282509ff4 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:27.947792 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:27.960779 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e0107-06ed-4c07-a0bd-f0d96a21faa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:27.961439 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e0107-06ed-4c07-a0bd-f0d96a21faa0 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:27.961722 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e0107-06ed-4c07-a0bd-f0d96a21faa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:27.961996 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e0107-06ed-4c07-a0bd-f0d96a21faa0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:27.974715 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e0107-06ed-4c07-a0bd-f0d96a21faa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:42:27.980757 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-dc8e0107-06ed-4c07-a0bd-f0d96a21faa0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:42:27.980757 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:27.980757 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:42:27.980757 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:42:27.980757 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:42:27.980757 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:42:27.980757 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:42:27.980757 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:42:27.980757 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:42:27.980757 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:42:27.980757 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:42:27.980757 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:42:27.980757 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:42:27.980757 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:42:27.980757 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:42:27.980757 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:42:27.981636 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:42:27.981636 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:42:27.981636 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:42:27.981636 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:42:27.981636 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:42:27.981636 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:42:27.981636 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:42:27.981636 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:42:27.981636 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:42:27.981636 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:42:27.981636 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:42:27.981636 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:42:27.981636 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:42:27.981636 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:42:27.981636 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:42:27.981636 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:42:27.982413 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:42:27.982413 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:42:27.982413 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:42:27.982413 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:42:27.982413 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:42:27.982413 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:42:27.982413 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:42:27.982413 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:42:27.982413 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:42:27.982413 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:42:27.982413 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:42:27.982413 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:42:27.982413 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 30/64] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:42:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:42:27.988181 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2666c82-b269-43c0-907e-d07c2c811c84 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:27.988181 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2666c82-b269-43c0-907e-d07c2c811c84 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:27.988181 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2666c82-b269-43c0-907e-d07c2c811c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:28.003978 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-f2666c82-b269-43c0-907e-d07c2c811c84 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:28.005505 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-f2666c82-b269-43c0-907e-d07c2c811c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:28.016444 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb4fb8-bd33-4f14-83bf-a8d65e1d3b94 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:28.037294 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:28.055695 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1c8f9-a8b9-476c-8672-eb953230ec65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:28.056328 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1c8f9-a8b9-476c-8672-eb953230ec65 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:28.056607 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1c8f9-a8b9-476c-8672-eb953230ec65 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:28.056881 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1c8f9-a8b9-476c-8672-eb953230ec65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:28.068446 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1c8f9-a8b9-476c-8672-eb953230ec65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:42:28.073277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-f6d1c8f9-a8b9-476c-8672-eb953230ec65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:42:28.073277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:28.073277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:42:28.073277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:42:28.073277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:42:28.073277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:42:28.073277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:42:28.073277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:42:28.073277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:42:28.073277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:42:28.073277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:42:28.073277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:42:28.073277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:42:28.073277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:42:28.073277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:42:28.073277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:42:28.074380 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:42:28.074380 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:42:28.074380 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:42:28.074380 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:42:28.074380 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:42:28.074380 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:42:28.074380 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:42:28.074380 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:42:28.074380 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:42:28.074380 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:42:28.074380 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:42:28.074380 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:42:28.074380 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:42:28.074380 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:42:28.074380 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:42:28.074380 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:42:28.075452 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:42:28.075452 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:42:28.075452 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:42:28.075452 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:42:28.075452 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:42:28.075452 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:42:28.075452 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:42:28.075452 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:42:28.075452 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:42:28.075452 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:42:28.075452 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:42:28.075452 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:42:28.075452 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 35/65] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Oct 30 00:42:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:42:28.075452 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1c8f9-a8b9-476c-8672-eb953230ec65 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:28.091376 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 31/66] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:42:28.092220 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2666c82-b269-43c0-907e-d07c2c811c84 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:28.199497 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:28.204938 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1c8f9-a8b9-476c-8672-eb953230ec65 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:28.243569 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6575d0-9549-43e6-a966-ebce0a8c9c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:28.244181 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6575d0-9549-43e6-a966-ebce0a8c9c16 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:28.244458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6575d0-9549-43e6-a966-ebce0a8c9c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:28.244726 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6575d0-9549-43e6-a966-ebce0a8c9c16 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:28.245425 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6575d0-9549-43e6-a966-ebce0a8c9c16 None admin] RBAC: Adding query filter params (name=member) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:28.245723 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6575d0-9549-43e6-a966-ebce0a8c9c16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:28.247140 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6575d0-9549-43e6-a966-ebce0a8c9c16 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:28.261456 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 36/67] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Oct 30 00:42:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:28.261456 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6575d0-9549-43e6-a966-ebce0a8c9c16 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:28.306988 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2666c82-b269-43c0-907e-d07c2c811c84 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:28.343937 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9cc6b-6139-4470-9ba7-8cf9ab09f71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:28.344565 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9cc6b-6139-4470-9ba7-8cf9ab09f71b None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:28.344843 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9cc6b-6139-4470-9ba7-8cf9ab09f71b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:28.345115 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9cc6b-6139-4470-9ba7-8cf9ab09f71b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:28.355795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9cc6b-6139-4470-9ba7-8cf9ab09f71b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:42:28.361004 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-4ba9cc6b-6139-4470-9ba7-8cf9ab09f71b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:42:28.361004 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:28.361004 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:42:28.361004 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:42:28.361004 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:42:28.361004 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:42:28.361004 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:42:28.361004 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:42:28.361004 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:42:28.361004 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:42:28.361004 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:42:28.361004 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:42:28.361004 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:42:28.361004 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:42:28.361004 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:42:28.361004 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:42:28.362049 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:42:28.362049 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:42:28.362049 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:42:28.362049 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:42:28.362049 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:42:28.362049 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:42:28.362049 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:42:28.362049 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:42:28.362049 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:42:28.362049 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:42:28.362049 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:42:28.362049 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:42:28.362049 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:42:28.362049 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:42:28.362049 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:42:28.362049 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:42:28.367429 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:42:28.367429 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:42:28.367429 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:42:28.367429 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:42:28.367429 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:42:28.367429 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:42:28.367429 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:42:28.367429 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:42:28.367429 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:42:28.367429 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:42:28.367429 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:42:28.367429 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:42:28.367429 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 32/68] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Oct 30 00:42:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:42:28.367429 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9cc6b-6139-4470-9ba7-8cf9ab09f71b None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:28.376169 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6575d0-9549-43e6-a966-ebce0a8c9c16 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:28.386956 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:28.410727 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ef290-4142-4777-8905-4172565748d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:28.411319 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ef290-4142-4777-8905-4172565748d0 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:28.411595 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ef290-4142-4777-8905-4172565748d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:28.411863 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ef290-4142-4777-8905-4172565748d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:28.412513 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ef290-4142-4777-8905-4172565748d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:28.412818 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ef290-4142-4777-8905-4172565748d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:28.414220 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ef290-4142-4777-8905-4172565748d0 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:28.422516 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 37/69] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:42:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:28.427752 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ef290-4142-4777-8905-4172565748d0 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:28.451786 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:28.462039 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9cc6b-6139-4470-9ba7-8cf9ab09f71b None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:28.497133 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48b667-782a-4b32-a08f-d9defad63ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:28.498299 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48b667-782a-4b32-a08f-d9defad63ebe None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:28.498578 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48b667-782a-4b32-a08f-d9defad63ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:28.498847 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48b667-782a-4b32-a08f-d9defad63ebe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:28.508692 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48b667-782a-4b32-a08f-d9defad63ebe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:42:28.513571 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-ac48b667-782a-4b32-a08f-d9defad63ebe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:42:28.513571 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:28.513571 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:42:28.513571 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:42:28.513571 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:42:28.513571 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:42:28.513571 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:42:28.513571 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:42:28.513571 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:42:28.513571 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:42:28.513571 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:42:28.513571 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:42:28.513571 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:42:28.513571 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:42:28.513571 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:42:28.513571 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:42:28.514504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:42:28.514504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:42:28.514504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:42:28.514504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:42:28.514504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:42:28.514504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:42:28.514504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:42:28.514504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:42:28.514504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:42:28.514504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:42:28.514504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:42:28.514504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:42:28.514504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:42:28.514504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:42:28.514504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:42:28.514504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:42:28.515309 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:42:28.515309 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:42:28.515309 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:42:28.515309 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:42:28.515309 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:42:28.515309 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:42:28.515309 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:42:28.515309 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:42:28.515309 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:42:28.515309 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:42:28.515309 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:42:28.515309 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:42:28.515309 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 33/70] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:42:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:42:28.515945 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48b667-782a-4b32-a08f-d9defad63ebe None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:28.529938 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ef290-4142-4777-8905-4172565748d0 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:28.563183 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8aa95-0bab-47ce-96ca-19afc3612971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:28.563726 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8aa95-0bab-47ce-96ca-19afc3612971 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:28.564010 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8aa95-0bab-47ce-96ca-19afc3612971 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:28.564287 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8aa95-0bab-47ce-96ca-19afc3612971 None admin] PATH_INFO: `/v3/users/bcee6ba45b114c7895de9db68a7a8696` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:28.577280 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b8aa95-0bab-47ce-96ca-19afc3612971 None admin] RBAC: Authorizing `identity:get_user(user_id=bcee6ba45b114c7895de9db68a7a8696)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:28.578817 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b8aa95-0bab-47ce-96ca-19afc3612971 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:28.580496 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 38/71] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:42:28 2022] GET /identity/v3/users/bcee6ba45b114c7895de9db68a7a8696 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:28.581360 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8aa95-0bab-47ce-96ca-19afc3612971 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:28.598080 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:28.616283 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48b667-782a-4b32-a08f-d9defad63ebe None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:28.650159 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f6fa9-4989-4a71-a1f4-9ac1c59775e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:28.650776 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f6fa9-4989-4a71-a1f4-9ac1c59775e0 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:28.651055 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f6fa9-4989-4a71-a1f4-9ac1c59775e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:28.651327 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f6fa9-4989-4a71-a1f4-9ac1c59775e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:28.652442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f6fa9-4989-4a71-a1f4-9ac1c59775e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:28.654550 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f6fa9-4989-4a71-a1f4-9ac1c59775e0 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:28.656107 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 34/72] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:42:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:28.656864 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f6fa9-4989-4a71-a1f4-9ac1c59775e0 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:28.660951 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:28.681486 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8aa95-0bab-47ce-96ca-19afc3612971 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:28.714584 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fffbc5-d8cb-4bec-936c-5e5843bf5b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:28.715187 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fffbc5-d8cb-4bec-936c-5e5843bf5b49 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:28.715465 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fffbc5-d8cb-4bec-936c-5e5843bf5b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:28.715735 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fffbc5-d8cb-4bec-936c-5e5843bf5b49 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:28.716910 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fffbc5-d8cb-4bec-936c-5e5843bf5b49 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:28.717232 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fffbc5-d8cb-4bec-936c-5e5843bf5b49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:28.718613 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fffbc5-d8cb-4bec-936c-5e5843bf5b49 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:28.726412 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 39/73] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:42:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:28.727290 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fffbc5-d8cb-4bec-936c-5e5843bf5b49 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:28.759504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f6fa9-4989-4a71-a1f4-9ac1c59775e0 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:28.793272 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db963fc-e6f9-42ec-aae8-5cdbd62056bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:28.793886 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db963fc-e6f9-42ec-aae8-5cdbd62056bb None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:28.794169 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db963fc-e6f9-42ec-aae8-5cdbd62056bb None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:28.794486 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db963fc-e6f9-42ec-aae8-5cdbd62056bb None admin] PATH_INFO: `/v3/users/3d17e3752b7a4a7facf7de1b529ec751` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:28.795896 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db963fc-e6f9-42ec-aae8-5cdbd62056bb None admin] RBAC: Authorizing `identity:get_user(user_id=3d17e3752b7a4a7facf7de1b529ec751)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:28.797424 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db963fc-e6f9-42ec-aae8-5cdbd62056bb None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:28.798999 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 35/74] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:42:28 2022] GET /identity/v3/users/3d17e3752b7a4a7facf7de1b529ec751 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:28.799750 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db963fc-e6f9-42ec-aae8-5cdbd62056bb None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:28.818429 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:28.833654 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fffbc5-d8cb-4bec-936c-5e5843bf5b49 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:28.867562 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36a826-5fc3-4708-ada3-5d37ddde1533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:28.868158 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36a826-5fc3-4708-ada3-5d37ddde1533 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:28.868446 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36a826-5fc3-4708-ada3-5d37ddde1533 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:28.868715 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36a826-5fc3-4708-ada3-5d37ddde1533 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:28.869452 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36a826-5fc3-4708-ada3-5d37ddde1533 None admin] RBAC: Adding query filter params (name=member) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:28.869758 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36a826-5fc3-4708-ada3-5d37ddde1533 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:28.871162 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36a826-5fc3-4708-ada3-5d37ddde1533 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:28.879000 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 40/75] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Oct 30 00:42:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:28.879762 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36a826-5fc3-4708-ada3-5d37ddde1533 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:28.883014 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:28.902774 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db963fc-e6f9-42ec-aae8-5cdbd62056bb None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:28.935462 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db6794-5636-4128-aaf1-9a8dcee067cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:28.936072 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db6794-5636-4128-aaf1-9a8dcee067cf None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:28.936346 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db6794-5636-4128-aaf1-9a8dcee067cf None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:28.936617 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db6794-5636-4128-aaf1-9a8dcee067cf None admin] PATH_INFO: `/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:28.937751 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db6794-5636-4128-aaf1-9a8dcee067cf None admin] RBAC: Authorizing `identity:get_project(project_id=bbcd0ae183934d41a9caeb3d9450db6e)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:28.939186 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db6794-5636-4128-aaf1-9a8dcee067cf None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:28.940789 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 36/76] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Oct 30 00:42:28 2022] GET /identity/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:28.941560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db6794-5636-4128-aaf1-9a8dcee067cf None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:28.978263 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36a826-5fc3-4708-ada3-5d37ddde1533 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:29.011135 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407fd89-3c04-4121-884b-c8bf2520aee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:29.011744 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407fd89-3c04-4121-884b-c8bf2520aee4 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:29.012032 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407fd89-3c04-4121-884b-c8bf2520aee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:29.012312 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407fd89-3c04-4121-884b-c8bf2520aee4 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:29.013538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407fd89-3c04-4121-884b-c8bf2520aee4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:29.014936 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407fd89-3c04-4121-884b-c8bf2520aee4 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:29.025833 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:29.049224 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 41/77] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Oct 30 00:42:28 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:42:29.049224 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407fd89-3c04-4121-884b-c8bf2520aee4 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:29.049504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db6794-5636-4128-aaf1-9a8dcee067cf None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:29.085113 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815fc5e-e61d-433d-ad9c-03c16a06bb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:29.085705 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815fc5e-e61d-433d-ad9c-03c16a06bb5e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:29.085980 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815fc5e-e61d-433d-ad9c-03c16a06bb5e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:29.086250 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815fc5e-e61d-433d-ad9c-03c16a06bb5e None admin] PATH_INFO: `/v3/users/bcee6ba45b114c7895de9db68a7a8696` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:29.087533 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815fc5e-e61d-433d-ad9c-03c16a06bb5e None admin] RBAC: Authorizing `identity:get_user(user_id=bcee6ba45b114c7895de9db68a7a8696)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:29.089043 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815fc5e-e61d-433d-ad9c-03c16a06bb5e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:29.096605 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 37/78] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:42:28 2022] GET /identity/v3/users/bcee6ba45b114c7895de9db68a7a8696 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:29.096605 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815fc5e-e61d-433d-ad9c-03c16a06bb5e None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:29.112832 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:29.158641 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407fd89-3c04-4121-884b-c8bf2520aee4 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:29.204035 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc1005-82fd-4a1f-afc3-4286fb1f5866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:29.205495 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc1005-82fd-4a1f-afc3-4286fb1f5866 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:29.205780 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc1005-82fd-4a1f-afc3-4286fb1f5866 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:29.206065 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc1005-82fd-4a1f-afc3-4286fb1f5866 None admin] PATH_INFO: `/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:29.207254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc1005-82fd-4a1f-afc3-4286fb1f5866 None admin] RBAC: Authorizing `identity:get_project(project_id=bbcd0ae183934d41a9caeb3d9450db6e)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:29.208716 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc1005-82fd-4a1f-afc3-4286fb1f5866 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:29.213224 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 42/79] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Oct 30 00:42:29 2022] GET /identity/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:29.213224 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc1005-82fd-4a1f-afc3-4286fb1f5866 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:29.219230 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815fc5e-e61d-433d-ad9c-03c16a06bb5e None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:29.257590 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43944af4-5bb0-4e97-a883-a52be76e3e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:29.258896 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43944af4-5bb0-4e97-a883-a52be76e3e37 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:29.259177 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43944af4-5bb0-4e97-a883-a52be76e3e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:29.259464 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43944af4-5bb0-4e97-a883-a52be76e3e37 None admin] PATH_INFO: `/v3/users/bcee6ba45b114c7895de9db68a7a8696` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:29.260721 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43944af4-5bb0-4e97-a883-a52be76e3e37 None admin] RBAC: Authorizing `identity:get_user(user_id=bcee6ba45b114c7895de9db68a7a8696)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:29.262307 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43944af4-5bb0-4e97-a883-a52be76e3e37 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:29.265924 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 38/80] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:42:29 2022] GET /identity/v3/users/bcee6ba45b114c7895de9db68a7a8696 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:29.266038 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43944af4-5bb0-4e97-a883-a52be76e3e37 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:29.296029 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:29.331436 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc1005-82fd-4a1f-afc3-4286fb1f5866 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:29.366569 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:29.379634 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75248239-2a2f-4356-bcd7-91429c6905d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:29.379634 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75248239-2a2f-4356-bcd7-91429c6905d5 None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:29.379634 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75248239-2a2f-4356-bcd7-91429c6905d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:29.379634 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75248239-2a2f-4356-bcd7-91429c6905d5 None admin] PATH_INFO: `/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e/users/bcee6ba45b114c7895de9db68a7a8696/roles/a2f2dde26304402eb433d8d8cfaca1e7` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:29.383305 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75248239-2a2f-4356-bcd7-91429c6905d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=bbcd0ae183934d41a9caeb3d9450db6e, user_id=bcee6ba45b114c7895de9db68a7a8696, role_id=a2f2dde26304402eb433d8d8cfaca1e7)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:29.383545 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75248239-2a2f-4356-bcd7-91429c6905d5 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:29.393098 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43944af4-5bb0-4e97-a883-a52be76e3e37 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:29.408284 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 43/81] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Oct 30 00:42:29 2022] PUT /identity/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e/users/bcee6ba45b114c7895de9db68a7a8696/roles/a2f2dde26304402eb433d8d8cfaca1e7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:42:29.409340 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75248239-2a2f-4356-bcd7-91429c6905d5 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:29.441454 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35493d2b-a621-46a1-b653-3bc362a0cbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:29.442100 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35493d2b-a621-46a1-b653-3bc362a0cbac None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:29.442381 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35493d2b-a621-46a1-b653-3bc362a0cbac None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:29.442830 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35493d2b-a621-46a1-b653-3bc362a0cbac None admin] PATH_INFO: `/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:29.444468 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35493d2b-a621-46a1-b653-3bc362a0cbac None admin] RBAC: Authorizing `identity:get_project(project_id=bbcd0ae183934d41a9caeb3d9450db6e)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:29.446509 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35493d2b-a621-46a1-b653-3bc362a0cbac None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:29.449218 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 39/82] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Oct 30 00:42:29 2022] GET /identity/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:29.450049 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35493d2b-a621-46a1-b653-3bc362a0cbac None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:29.526926 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75248239-2a2f-4356-bcd7-91429c6905d5 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:29.565806 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7ca3b-be87-4a9c-8b8f-0420e1770b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:29.566898 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7ca3b-be87-4a9c-8b8f-0420e1770b2f None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:29.567492 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7ca3b-be87-4a9c-8b8f-0420e1770b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:29.567947 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7ca3b-be87-4a9c-8b8f-0420e1770b2f None admin] PATH_INFO: `/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e/users/3d17e3752b7a4a7facf7de1b529ec751/roles/17d0330d6df84d3091d7ef234dfc4e6b` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:29.570464 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7ca3b-be87-4a9c-8b8f-0420e1770b2f None admin] RBAC: Authorizing `identity:create_grant(project_id=bbcd0ae183934d41a9caeb3d9450db6e, user_id=3d17e3752b7a4a7facf7de1b529ec751, role_id=17d0330d6df84d3091d7ef234dfc4e6b)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:29.572280 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7ca3b-be87-4a9c-8b8f-0420e1770b2f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:29.578990 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:29.590413 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35493d2b-a621-46a1-b653-3bc362a0cbac None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:29.600979 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 44/83] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Oct 30 00:42:29 2022] PUT /identity/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e/users/3d17e3752b7a4a7facf7de1b529ec751/roles/17d0330d6df84d3091d7ef234dfc4e6b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:42:29.602073 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7ca3b-be87-4a9c-8b8f-0420e1770b2f None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:29.631372 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad1844-7619-49e7-b0c5-3a0793a49a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:29.631983 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad1844-7619-49e7-b0c5-3a0793a49a4a None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:29.632260 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad1844-7619-49e7-b0c5-3a0793a49a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:29.632535 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad1844-7619-49e7-b0c5-3a0793a49a4a None admin] PATH_INFO: `/v3/projects/751220a24696458b8f48b6846c09cb74` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:29.633964 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad1844-7619-49e7-b0c5-3a0793a49a4a None admin] RBAC: Authorizing `identity:get_project(project_id=751220a24696458b8f48b6846c09cb74)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:29.636129 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad1844-7619-49e7-b0c5-3a0793a49a4a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:29.638343 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 40/84] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Oct 30 00:42:29 2022] GET /identity/v3/projects/751220a24696458b8f48b6846c09cb74 => generated 312 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:29.645437 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad1844-7619-49e7-b0c5-3a0793a49a4a None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:29.719035 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:29.820390 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad1844-7619-49e7-b0c5-3a0793a49a4a None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:29.840290 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7ca3b-be87-4a9c-8b8f-0420e1770b2f None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:29.874123 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c16c8-f947-4b23-a6ce-b6bc940bbba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:29.875386 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c16c8-f947-4b23-a6ce-b6bc940bbba6 None admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:29.875674 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c16c8-f947-4b23-a6ce-b6bc940bbba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:29.875958 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c16c8-f947-4b23-a6ce-b6bc940bbba6 None admin] PATH_INFO: `/v3/projects/751220a24696458b8f48b6846c09cb74/users/bcee6ba45b114c7895de9db68a7a8696/roles/a2f2dde26304402eb433d8d8cfaca1e7` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:29.879664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c16c8-f947-4b23-a6ce-b6bc940bbba6 None admin] RBAC: Authorizing `identity:create_grant(project_id=751220a24696458b8f48b6846c09cb74, user_id=bcee6ba45b114c7895de9db68a7a8696, role_id=a2f2dde26304402eb433d8d8cfaca1e7)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:29.881141 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c16c8-f947-4b23-a6ce-b6bc940bbba6 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:29.901898 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 41/85] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Oct 30 00:42:29 2022] PUT /identity/v3/projects/751220a24696458b8f48b6846c09cb74/users/bcee6ba45b114c7895de9db68a7a8696/roles/a2f2dde26304402eb433d8d8cfaca1e7 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:42:29.914748 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c3692-69f8-4f4a-8793-7d7788fae027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:29.915444 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c3692-69f8-4f4a-8793-7d7788fae027 None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:29.915775 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c3692-69f8-4f4a-8793-7d7788fae027 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:29.916065 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c3692-69f8-4f4a-8793-7d7788fae027 None admin] PATH_INFO: `/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e/users/bcee6ba45b114c7895de9db68a7a8696/roles/b63857cb2ff04d189523309091368e81` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:29.921339 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c3692-69f8-4f4a-8793-7d7788fae027 None admin] RBAC: Authorizing `identity:create_grant(project_id=bbcd0ae183934d41a9caeb3d9450db6e, user_id=bcee6ba45b114c7895de9db68a7a8696, role_id=b63857cb2ff04d189523309091368e81)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:29.922903 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c3692-69f8-4f4a-8793-7d7788fae027 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:29.946928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 45/86] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Oct 30 00:42:29 2022] PUT /identity/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e/users/bcee6ba45b114c7895de9db68a7a8696/roles/b63857cb2ff04d189523309091368e81 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:42:31.951286 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fff54-d969-403c-be1f-426c19230e18 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:31.952266 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fff54-d969-403c-be1f-426c19230e18 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:31.952770 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fff54-d969-403c-be1f-426c19230e18 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:31.954596 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 42/87] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:31.960130 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdcc67-8169-4e45-a6e0-9dc61e87c8e3 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:31.960934 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdcc67-8169-4e45-a6e0-9dc61e87c8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:31.961470 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdcc67-8169-4e45-a6e0-9dc61e87c8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:31.988708 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-48bdcc67-8169-4e45-a6e0-9dc61e87c8e3 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:31.990256 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-48bdcc67-8169-4e45-a6e0-9dc61e87c8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:32.084164 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 46/88] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:42:32.626444 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6fff54-d969-403c-be1f-426c19230e18 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:32.652802 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:32.716927 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8896db6-7e9e-460e-8a29-c8e8add4df05 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:32.717608 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8896db6-7e9e-460e-8a29-c8e8add4df05 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:32.718113 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8896db6-7e9e-460e-8a29-c8e8add4df05 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:32.719775 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 47/89] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:32.725715 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc7db2-064d-438a-a592-626303640f9c None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:32.726313 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc7db2-064d-438a-a592-626303640f9c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:32.726806 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc7db2-064d-438a-a592-626303640f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:32.746674 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-18fc7db2-064d-438a-a592-626303640f9c None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:32.748376 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-18fc7db2-064d-438a-a592-626303640f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:32.758819 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6fff54-d969-403c-be1f-426c19230e18 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:32.782908 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:32.815700 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803f0d7-2e12-481b-aaea-6b23ef7ccfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:32.816335 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803f0d7-2e12-481b-aaea-6b23ef7ccfb1 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:32.816650 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803f0d7-2e12-481b-aaea-6b23ef7ccfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:32.816898 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803f0d7-2e12-481b-aaea-6b23ef7ccfb1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:32.822092 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803f0d7-2e12-481b-aaea-6b23ef7ccfb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:32.823578 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803f0d7-2e12-481b-aaea-6b23ef7ccfb1 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:32.829224 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 43/90] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:42:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:32.829224 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b317b4-9856-4461-ae9b-8269e8983294 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:32.829224 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b317b4-9856-4461-ae9b-8269e8983294 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:32.829224 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b317b4-9856-4461-ae9b-8269e8983294 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:32.831687 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 44/91] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:32.831687 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b317b4-9856-4461-ae9b-8269e8983294 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:32.838849 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 48/92] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:42:32.840358 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552b3ca-04d4-4a60-a718-613f9872408c None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:32.840830 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552b3ca-04d4-4a60-a718-613f9872408c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:32.841823 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552b3ca-04d4-4a60-a718-613f9872408c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:32.872707 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-9552b3ca-04d4-4a60-a718-613f9872408c None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:32.874243 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9552b3ca-04d4-4a60-a718-613f9872408c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:32.927849 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:32.946975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b317b4-9856-4461-ae9b-8269e8983294 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:32.983376 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 49/93] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:42:32.985220 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3999ecd-3a20-40df-beb0-ded536e451ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:32.985898 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3999ecd-3a20-40df-beb0-ded536e451ea None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:32.986216 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaafe2-a7ef-4e66-a2d7-302ab665cb20 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:32.986323 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3999ecd-3a20-40df-beb0-ded536e451ea None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:32.986621 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3999ecd-3a20-40df-beb0-ded536e451ea None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:32.986944 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaafe2-a7ef-4e66-a2d7-302ab665cb20 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:32.987410 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3999ecd-3a20-40df-beb0-ded536e451ea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:32.987517 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaafe2-a7ef-4e66-a2d7-302ab665cb20 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:32.988964 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3999ecd-3a20-40df-beb0-ded536e451ea None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:32.989074 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 50/94] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:32.990383 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510dd12-cc29-4c52-b2d1-0e6c3d38bc03 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:32.990837 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510dd12-cc29-4c52-b2d1-0e6c3d38bc03 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:32.991298 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510dd12-cc29-4c52-b2d1-0e6c3d38bc03 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:32.992704 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 51/95] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:32.998297 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986aec48-e641-4570-8b94-a51b252f16c3 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:32.998803 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986aec48-e641-4570-8b94-a51b252f16c3 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:32.999289 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986aec48-e641-4570-8b94-a51b252f16c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:33.018711 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-986aec48-e641-4570-8b94-a51b252f16c3 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:33.019274 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 45/96] 10.222.0.40 () {60 vars in 1141 bytes} [Sun Oct 30 00:42:32 2022] POST /identity/v3/projects => generated 302 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:42:33.020436 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-986aec48-e641-4570-8b94-a51b252f16c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:33.020840 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1ce5b-81eb-4a77-8a18-dd8a6b37ba65 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:33.021207 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1ce5b-81eb-4a77-8a18-dd8a6b37ba65 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:33.021573 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1ce5b-81eb-4a77-8a18-dd8a6b37ba65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:33.050289 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-6cc1ce5b-81eb-4a77-8a18-dd8a6b37ba65 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:33.051739 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-6cc1ce5b-81eb-4a77-8a18-dd8a6b37ba65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:33.129136 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 46/97] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:42:33.163399 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 52/98] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:42:33.294975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1ce5b-81eb-4a77-8a18-dd8a6b37ba65 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:33.386953 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:33.427232 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1ce5b-81eb-4a77-8a18-dd8a6b37ba65 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:33.440220 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986aec48-e641-4570-8b94-a51b252f16c3 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:33.469008 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0869fb-b71e-433d-8bc0-d09df1480a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:33.469729 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0869fb-b71e-433d-8bc0-d09df1480a3e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:33.470078 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0869fb-b71e-433d-8bc0-d09df1480a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:33.470473 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0869fb-b71e-433d-8bc0-d09df1480a3e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:33.485471 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0869fb-b71e-433d-8bc0-d09df1480a3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:42:33.488048 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:33.491385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-fe0869fb-b71e-433d-8bc0-d09df1480a3e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:42:33.491385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:33.491385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:42:33.491385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:42:33.491385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:42:33.491385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:42:33.491385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:42:33.491385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:42:33.491385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:42:33.491385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:42:33.491385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:42:33.491385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:42:33.491385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:42:33.491385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:42:33.491385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:42:33.491385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:42:33.492422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:42:33.492422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:42:33.492422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:42:33.492422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:42:33.492422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:42:33.492422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:42:33.492422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:42:33.492422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:42:33.492422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:42:33.492422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:42:33.492422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:42:33.492422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:42:33.492422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:42:33.492422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:42:33.492422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:42:33.492422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:42:33.493381 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:42:33.493381 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:42:33.493381 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:42:33.493381 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:42:33.493381 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:42:33.493381 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:42:33.493381 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:42:33.493381 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:42:33.493381 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:42:33.493381 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:42:33.493381 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:42:33.493381 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:42:33.496451 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 47/99] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:42:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:42:33.499176 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf09cf-8547-466f-998b-c6cb9fb09dc9 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:33.499605 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf09cf-8547-466f-998b-c6cb9fb09dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:33.500077 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf09cf-8547-466f-998b-c6cb9fb09dc9 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:33.501527 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 48/100] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:33.506929 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da4bfd-4559-40bf-a1fc-f99d112862df None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:33.507220 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da4bfd-4559-40bf-a1fc-f99d112862df None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:33.507500 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da4bfd-4559-40bf-a1fc-f99d112862df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:33.526469 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-b2da4bfd-4559-40bf-a1fc-f99d112862df None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:33.527883 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-b2da4bfd-4559-40bf-a1fc-f99d112862df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:33.580073 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986aec48-e641-4570-8b94-a51b252f16c3 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:33.613336 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 49/101] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:42:33.614230 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da4bfd-4559-40bf-a1fc-f99d112862df None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:33.620577 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcaec44-224e-4640-89a3-4dc108614f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:33.621511 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcaec44-224e-4640-89a3-4dc108614f8a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:33.621974 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcaec44-224e-4640-89a3-4dc108614f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:33.623103 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcaec44-224e-4640-89a3-4dc108614f8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:33.634608 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcaec44-224e-4640-89a3-4dc108614f8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:42:33.639991 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-6fcaec44-224e-4640-89a3-4dc108614f8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:42:33.639991 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:33.639991 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:42:33.639991 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:42:33.639991 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:42:33.639991 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:42:33.639991 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:42:33.639991 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:42:33.639991 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:42:33.639991 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:42:33.639991 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:42:33.639991 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:42:33.639991 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:42:33.639991 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:42:33.639991 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:42:33.639991 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:42:33.640858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:42:33.640858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:42:33.640858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:42:33.640858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:42:33.640858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:42:33.640858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:42:33.640858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:42:33.640858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:42:33.640858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:42:33.640858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:42:33.640858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:42:33.640858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:42:33.640858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:42:33.640858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:42:33.640858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:42:33.640858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:42:33.641657 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:42:33.641657 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:42:33.641657 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:42:33.641657 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:42:33.641657 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:42:33.641657 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:42:33.641657 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:42:33.641657 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:42:33.641657 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:42:33.641657 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:42:33.641657 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:42:33.641657 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:42:33.644411 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 53/102] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Oct 30 00:42:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:42:33.645551 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcaec44-224e-4640-89a3-4dc108614f8a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:33.686397 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:33.735856 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da4bfd-4559-40bf-a1fc-f99d112862df None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:33.757962 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:33.772369 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcaec44-224e-4640-89a3-4dc108614f8a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:33.777664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9fa69-bb71-4e1d-9ec1-3c07ed4ac1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:33.778995 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9fa69-bb71-4e1d-9ec1-3c07ed4ac1ed None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:33.779422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9fa69-bb71-4e1d-9ec1-3c07ed4ac1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:33.779837 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9fa69-bb71-4e1d-9ec1-3c07ed4ac1ed None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:33.780638 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9fa69-bb71-4e1d-9ec1-3c07ed4ac1ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:33.781080 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9fa69-bb71-4e1d-9ec1-3c07ed4ac1ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:33.783193 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9fa69-bb71-4e1d-9ec1-3c07ed4ac1ed None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:33.793537 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 50/103] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Oct 30 00:42:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:33.795151 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9fa69-bb71-4e1d-9ec1-3c07ed4ac1ed None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:33.823479 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb89af-d49c-45f8-818e-156e8f20ac1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:33.824336 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb89af-d49c-45f8-818e-156e8f20ac1d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:33.824817 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb89af-d49c-45f8-818e-156e8f20ac1d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:33.825267 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb89af-d49c-45f8-818e-156e8f20ac1d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:33.839397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb89af-d49c-45f8-818e-156e8f20ac1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:42:33.845824 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-94fb89af-d49c-45f8-818e-156e8f20ac1d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:42:33.845824 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:33.845824 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:42:33.845824 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:42:33.845824 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:42:33.845824 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:42:33.845824 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:42:33.845824 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:42:33.845824 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:42:33.845824 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:42:33.845824 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:42:33.845824 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:42:33.845824 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:42:33.845824 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:42:33.845824 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:42:33.845824 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:42:33.846698 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:42:33.846698 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:42:33.846698 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:42:33.846698 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:42:33.846698 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:42:33.846698 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:42:33.846698 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:42:33.846698 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:42:33.846698 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:42:33.846698 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:42:33.846698 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:42:33.846698 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:42:33.846698 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:42:33.846698 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:42:33.846698 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:42:33.846698 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:42:33.847478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:42:33.847478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:42:33.847478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:42:33.847478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:42:33.847478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:42:33.847478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:42:33.847478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:42:33.847478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:42:33.847478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:42:33.847478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:42:33.847478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:42:33.847478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:42:33.847478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 54/104] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:42:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:42:33.848114 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb89af-d49c-45f8-818e-156e8f20ac1d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:33.924564 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9fa69-bb71-4e1d-9ec1-3c07ed4ac1ed None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:33.945400 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:33.960489 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb665b-8ab5-4aaa-b5aa-3350cf0af960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:33.961118 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb665b-8ab5-4aaa-b5aa-3350cf0af960 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:33.961444 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb665b-8ab5-4aaa-b5aa-3350cf0af960 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:33.961723 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb665b-8ab5-4aaa-b5aa-3350cf0af960 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:33.965732 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb89af-d49c-45f8-818e-156e8f20ac1d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:33.972631 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb665b-8ab5-4aaa-b5aa-3350cf0af960 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:42:33.977959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-e2fb665b-8ab5-4aaa-b5aa-3350cf0af960 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:42:33.977959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:33.977959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:42:33.977959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:42:33.977959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:42:33.977959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:42:33.977959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:42:33.977959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:42:33.977959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:42:33.977959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:42:33.977959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:42:33.977959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:42:33.977959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:42:33.977959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:42:33.977959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:42:33.977959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:42:33.978819 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:42:33.978819 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:42:33.978819 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:42:33.978819 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:42:33.978819 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:42:33.978819 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:42:33.978819 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:42:33.978819 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:42:33.978819 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:42:33.978819 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:42:33.978819 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:42:33.978819 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:42:33.978819 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:42:33.978819 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:42:33.978819 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:42:33.978819 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:42:33.979592 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:42:33.979592 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:42:33.979592 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:42:33.979592 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:42:33.979592 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:42:33.979592 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:42:33.979592 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:42:33.979592 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:42:33.979592 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:42:33.979592 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:42:33.979592 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:42:33.979592 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:42:33.979592 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 51/105] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:42:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:42:33.980208 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb665b-8ab5-4aaa-b5aa-3350cf0af960 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:34.007988 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc2655-941f-460b-a425-d63927a0780a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:34.008592 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc2655-941f-460b-a425-d63927a0780a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:34.008870 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc2655-941f-460b-a425-d63927a0780a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:34.009142 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc2655-941f-460b-a425-d63927a0780a None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:34.009841 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc2655-941f-460b-a425-d63927a0780a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:34.010143 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc2655-941f-460b-a425-d63927a0780a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:34.011520 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc2655-941f-460b-a425-d63927a0780a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:34.026350 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 55/106] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:42:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:34.026350 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc2655-941f-460b-a425-d63927a0780a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:34.040224 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:34.089291 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb665b-8ab5-4aaa-b5aa-3350cf0af960 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:34.124507 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fe77e-bd3d-4aa6-9cc6-54bc6453b9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:34.125047 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fe77e-bd3d-4aa6-9cc6-54bc6453b9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:34.125361 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fe77e-bd3d-4aa6-9cc6-54bc6453b9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:34.125638 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fe77e-bd3d-4aa6-9cc6-54bc6453b9a9 None admin] PATH_INFO: `/v3/users/3a0e71a80d964fcc805cb21322add85a` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:34.142114 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0fe77e-bd3d-4aa6-9cc6-54bc6453b9a9 None admin] RBAC: Authorizing `identity:get_user(user_id=3a0e71a80d964fcc805cb21322add85a)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:34.143955 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0fe77e-bd3d-4aa6-9cc6-54bc6453b9a9 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:34.150212 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 52/107] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:42:33 2022] GET /identity/v3/users/3a0e71a80d964fcc805cb21322add85a => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:34.150212 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fe77e-bd3d-4aa6-9cc6-54bc6453b9a9 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:34.152899 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc2655-941f-460b-a425-d63927a0780a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:34.187203 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:34.190508 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0ee40-a21e-4279-a463-402f0b7e496f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:34.191142 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0ee40-a21e-4279-a463-402f0b7e496f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:34.191426 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0ee40-a21e-4279-a463-402f0b7e496f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:34.191705 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0ee40-a21e-4279-a463-402f0b7e496f None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:34.192365 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0ee40-a21e-4279-a463-402f0b7e496f None admin] RBAC: Adding query filter params (name=member) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:34.192671 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0ee40-a21e-4279-a463-402f0b7e496f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:34.194075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0ee40-a21e-4279-a463-402f0b7e496f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:34.207352 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 56/108] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Oct 30 00:42:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:34.207352 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0ee40-a21e-4279-a463-402f0b7e496f None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:34.259576 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fe77e-bd3d-4aa6-9cc6-54bc6453b9a9 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:34.285292 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:34.298466 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15557724-f5c9-4d21-8d13-be0646b1d8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:34.299094 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15557724-f5c9-4d21-8d13-be0646b1d8fd None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:34.299376 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15557724-f5c9-4d21-8d13-be0646b1d8fd None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:34.299653 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15557724-f5c9-4d21-8d13-be0646b1d8fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:34.310096 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15557724-f5c9-4d21-8d13-be0646b1d8fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:42:34.314899 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-15557724-f5c9-4d21-8d13-be0646b1d8fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:42:34.314899 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:34.314899 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:42:34.314899 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:42:34.314899 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:42:34.314899 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:42:34.314899 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:42:34.314899 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:42:34.314899 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:42:34.314899 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:42:34.314899 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:42:34.314899 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:42:34.314899 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:42:34.314899 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:42:34.314899 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:42:34.314899 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:42:34.315740 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:42:34.315740 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:42:34.315740 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:42:34.315740 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:42:34.315740 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:42:34.315740 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:42:34.315740 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:42:34.315740 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:42:34.315740 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:42:34.315740 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:42:34.315740 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:42:34.315740 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:42:34.315740 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:42:34.315740 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:42:34.315740 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:42:34.315740 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:42:34.316499 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:42:34.316499 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:42:34.316499 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:42:34.316499 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:42:34.316499 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:42:34.316499 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:42:34.316499 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:42:34.316499 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:42:34.316499 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:42:34.316499 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:42:34.316499 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:42:34.316499 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:42:34.316499 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 53/109] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Oct 30 00:42:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:42:34.317765 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0ee40-a21e-4279-a463-402f0b7e496f None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:34.321771 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15557724-f5c9-4d21-8d13-be0646b1d8fd None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:34.356841 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63567c36-3bee-46a5-b277-14399f49983a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:34.357472 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63567c36-3bee-46a5-b277-14399f49983a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:34.357755 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63567c36-3bee-46a5-b277-14399f49983a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:34.358033 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63567c36-3bee-46a5-b277-14399f49983a None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:34.358685 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63567c36-3bee-46a5-b277-14399f49983a None admin] RBAC: Adding query filter params (name=member) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:34.358990 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63567c36-3bee-46a5-b277-14399f49983a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:34.360370 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63567c36-3bee-46a5-b277-14399f49983a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:34.375615 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 57/110] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Oct 30 00:42:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:34.375615 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63567c36-3bee-46a5-b277-14399f49983a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:34.433233 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:34.437771 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15557724-f5c9-4d21-8d13-be0646b1d8fd None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:34.475277 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63aa5f-6dd9-42bf-820e-20a5f43508e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:34.476220 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63aa5f-6dd9-42bf-820e-20a5f43508e6 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:34.476706 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63aa5f-6dd9-42bf-820e-20a5f43508e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:34.477150 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63aa5f-6dd9-42bf-820e-20a5f43508e6 None admin] PATH_INFO: `/v3/users/3d17e3752b7a4a7facf7de1b529ec751` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:34.478288 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63567c36-3bee-46a5-b277-14399f49983a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:34.478647 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b63aa5f-6dd9-42bf-820e-20a5f43508e6 None admin] RBAC: Authorizing `identity:get_user(user_id=3d17e3752b7a4a7facf7de1b529ec751)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:34.480607 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b63aa5f-6dd9-42bf-820e-20a5f43508e6 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:34.482551 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 54/111] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:42:34 2022] GET /identity/v3/users/3d17e3752b7a4a7facf7de1b529ec751 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:34.483327 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63aa5f-6dd9-42bf-820e-20a5f43508e6 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:34.516532 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c471a3-84e4-4251-bb60-363a8078302c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:34.517434 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c471a3-84e4-4251-bb60-363a8078302c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:34.518309 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c471a3-84e4-4251-bb60-363a8078302c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:34.518790 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c471a3-84e4-4251-bb60-363a8078302c None admin] PATH_INFO: `/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:34.520159 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c471a3-84e4-4251-bb60-363a8078302c None admin] RBAC: Authorizing `identity:get_project(project_id=bbcd0ae183934d41a9caeb3d9450db6e)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:34.521772 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c471a3-84e4-4251-bb60-363a8078302c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:34.524005 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 58/112] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Oct 30 00:42:34 2022] GET /identity/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:34.524887 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c471a3-84e4-4251-bb60-363a8078302c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:34.531546 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:34.591564 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63aa5f-6dd9-42bf-820e-20a5f43508e6 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:34.630700 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0071f6c-0080-44be-b43a-4e407663145f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:34.631230 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0071f6c-0080-44be-b43a-4e407663145f None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:34.631520 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0071f6c-0080-44be-b43a-4e407663145f None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:34.631768 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0071f6c-0080-44be-b43a-4e407663145f None admin] PATH_INFO: `/v3/users/bcee6ba45b114c7895de9db68a7a8696` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:34.632865 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0071f6c-0080-44be-b43a-4e407663145f None admin] RBAC: Authorizing `identity:get_user(user_id=bcee6ba45b114c7895de9db68a7a8696)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:34.634346 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0071f6c-0080-44be-b43a-4e407663145f None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:34.635175 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c471a3-84e4-4251-bb60-363a8078302c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:34.636106 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 55/113] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:42:34 2022] GET /identity/v3/users/bcee6ba45b114c7895de9db68a7a8696 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:34.636659 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0071f6c-0080-44be-b43a-4e407663145f None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:34.676068 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e94338-0af0-4054-9d72-4cf040f766ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:34.676747 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e94338-0af0-4054-9d72-4cf040f766ec None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:34.677282 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e94338-0af0-4054-9d72-4cf040f766ec None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:34.677408 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e94338-0af0-4054-9d72-4cf040f766ec None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:34.677823 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:34.678077 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e94338-0af0-4054-9d72-4cf040f766ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:34.678377 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e94338-0af0-4054-9d72-4cf040f766ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:34.679966 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e94338-0af0-4054-9d72-4cf040f766ec None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:34.688684 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 59/114] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:42:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:34.689394 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e94338-0af0-4054-9d72-4cf040f766ec None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:34.753824 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0071f6c-0080-44be-b43a-4e407663145f None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:34.755544 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:34.790031 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7686003-a049-403e-be70-da42b3f866bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:34.790661 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7686003-a049-403e-be70-da42b3f866bc None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:34.790943 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7686003-a049-403e-be70-da42b3f866bc None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:34.791218 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7686003-a049-403e-be70-da42b3f866bc None admin] PATH_INFO: `/v3/users/bcee6ba45b114c7895de9db68a7a8696` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:34.792346 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7686003-a049-403e-be70-da42b3f866bc None admin] RBAC: Authorizing `identity:get_user(user_id=bcee6ba45b114c7895de9db68a7a8696)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:34.794073 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7686003-a049-403e-be70-da42b3f866bc None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:34.795617 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 56/115] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:42:34 2022] GET /identity/v3/users/bcee6ba45b114c7895de9db68a7a8696 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:34.796440 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7686003-a049-403e-be70-da42b3f866bc None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:34.797703 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e94338-0af0-4054-9d72-4cf040f766ec None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:34.832526 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7b529-d719-46ff-a5ac-4b5f6edb98e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:34.833235 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7b529-d719-46ff-a5ac-4b5f6edb98e3 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:34.833525 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7b529-d719-46ff-a5ac-4b5f6edb98e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:34.833799 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7b529-d719-46ff-a5ac-4b5f6edb98e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:34.897079 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7686003-a049-403e-be70-da42b3f866bc None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:34.898793 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:34.907816 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7b529-d719-46ff-a5ac-4b5f6edb98e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:34.909931 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7b529-d719-46ff-a5ac-4b5f6edb98e3 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:34.934391 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd8236-c13f-4707-aa7b-576ebfe298c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:34.935812 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd8236-c13f-4707-aa7b-576ebfe298c6 None admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:34.936089 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd8236-c13f-4707-aa7b-576ebfe298c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:34.936363 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd8236-c13f-4707-aa7b-576ebfe298c6 None admin] PATH_INFO: `/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e/users/3a0e71a80d964fcc805cb21322add85a/roles/bb8d5dabb95e46ef8120c17cbcca0566` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:34.938314 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd8236-c13f-4707-aa7b-576ebfe298c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=bbcd0ae183934d41a9caeb3d9450db6e, user_id=3a0e71a80d964fcc805cb21322add85a, role_id=bb8d5dabb95e46ef8120c17cbcca0566)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:34.939754 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd8236-c13f-4707-aa7b-576ebfe298c6 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:34.953078 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 57/116] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Oct 30 00:42:34 2022] PUT /identity/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e/users/3a0e71a80d964fcc805cb21322add85a/roles/bb8d5dabb95e46ef8120c17cbcca0566 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:42:34.953916 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd8236-c13f-4707-aa7b-576ebfe298c6 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:34.988452 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:35.037079 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 60/117] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Oct 30 00:42:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:42:35.037863 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7b529-d719-46ff-a5ac-4b5f6edb98e3 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:35.095252 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd8236-c13f-4707-aa7b-576ebfe298c6 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:35.139842 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96db82c-8e88-40b9-b8db-3c9b38b2f35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:35.140796 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96db82c-8e88-40b9-b8db-3c9b38b2f35f None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:35.140912 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96db82c-8e88-40b9-b8db-3c9b38b2f35f None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:35.141253 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96db82c-8e88-40b9-b8db-3c9b38b2f35f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:35.161685 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7b529-d719-46ff-a5ac-4b5f6edb98e3 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:35.181092 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:35.206195 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92253f-82da-45e2-9e52-1f87a4beac06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:35.206830 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92253f-82da-45e2-9e52-1f87a4beac06 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:35.207113 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92253f-82da-45e2-9e52-1f87a4beac06 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:35.207445 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92253f-82da-45e2-9e52-1f87a4beac06 None admin] PATH_INFO: `/v3/users/bcee6ba45b114c7895de9db68a7a8696` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:35.208698 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92253f-82da-45e2-9e52-1f87a4beac06 None admin] RBAC: Authorizing `identity:get_user(user_id=bcee6ba45b114c7895de9db68a7a8696)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:35.210372 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92253f-82da-45e2-9e52-1f87a4beac06 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:35.212199 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 61/118] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:42:35 2022] GET /identity/v3/users/bcee6ba45b114c7895de9db68a7a8696 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:35.213003 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92253f-82da-45e2-9e52-1f87a4beac06 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:35.242954 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96db82c-8e88-40b9-b8db-3c9b38b2f35f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:35.244636 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96db82c-8e88-40b9-b8db-3c9b38b2f35f None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:35.253559 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:35.330677 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92253f-82da-45e2-9e52-1f87a4beac06 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:35.364133 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 58/119] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Oct 30 00:42:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:42:35.365249 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96db82c-8e88-40b9-b8db-3c9b38b2f35f None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:35.379637 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346532a-f89c-43b3-94e6-412e0b6bd167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:35.380454 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346532a-f89c-43b3-94e6-412e0b6bd167 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:35.380870 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346532a-f89c-43b3-94e6-412e0b6bd167 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:35.381318 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346532a-f89c-43b3-94e6-412e0b6bd167 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:35.444726 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:35.463163 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346532a-f89c-43b3-94e6-412e0b6bd167 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:35.464962 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346532a-f89c-43b3-94e6-412e0b6bd167 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:35.497083 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:35.503061 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96db82c-8e88-40b9-b8db-3c9b38b2f35f None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:35.549587 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419a5b7-ad00-438a-85b3-6e86196e0f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:35.551026 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419a5b7-ad00-438a-85b3-6e86196e0f09 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:35.551662 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419a5b7-ad00-438a-85b3-6e86196e0f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:35.552218 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419a5b7-ad00-438a-85b3-6e86196e0f09 None admin] PATH_INFO: `/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:35.553896 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419a5b7-ad00-438a-85b3-6e86196e0f09 None admin] RBAC: Authorizing `identity:get_project(project_id=bbcd0ae183934d41a9caeb3d9450db6e)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:35.556352 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419a5b7-ad00-438a-85b3-6e86196e0f09 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:35.559015 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 59/120] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Oct 30 00:42:35 2022] GET /identity/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:35.560822 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419a5b7-ad00-438a-85b3-6e86196e0f09 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:35.574513 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 62/121] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Oct 30 00:42:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:42:35.575406 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346532a-f89c-43b3-94e6-412e0b6bd167 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:35.677055 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419a5b7-ad00-438a-85b3-6e86196e0f09 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:35.683176 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346532a-f89c-43b3-94e6-412e0b6bd167 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:35.707311 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:35.713743 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b215dec-cf31-45eb-931a-ead9f1dd26c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:35.714346 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b215dec-cf31-45eb-931a-ead9f1dd26c4 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:35.714624 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b215dec-cf31-45eb-931a-ead9f1dd26c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:35.714900 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b215dec-cf31-45eb-931a-ead9f1dd26c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:35.715412 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:35.721676 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52868ae-036b-4bcf-ac10-1a60912acb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:35.722314 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52868ae-036b-4bcf-ac10-1a60912acb42 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:35.722596 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52868ae-036b-4bcf-ac10-1a60912acb42 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:35.722871 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52868ae-036b-4bcf-ac10-1a60912acb42 None admin] PATH_INFO: `/v3/projects/751220a24696458b8f48b6846c09cb74` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:35.724010 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52868ae-036b-4bcf-ac10-1a60912acb42 None admin] RBAC: Authorizing `identity:get_project(project_id=751220a24696458b8f48b6846c09cb74)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:35.725499 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52868ae-036b-4bcf-ac10-1a60912acb42 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:35.727701 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 63/122] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Oct 30 00:42:35 2022] GET /identity/v3/projects/751220a24696458b8f48b6846c09cb74 => generated 312 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:35.728816 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172dd3da-876f-4e12-90be-05282a8a7245 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:35.729108 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172dd3da-876f-4e12-90be-05282a8a7245 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:35.729404 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172dd3da-876f-4e12-90be-05282a8a7245 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:35.730747 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 64/123] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:35.731377 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172dd3da-876f-4e12-90be-05282a8a7245 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:35.795115 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b215dec-cf31-45eb-931a-ead9f1dd26c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:35.796569 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b215dec-cf31-45eb-931a-ead9f1dd26c4 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:35.842526 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172dd3da-876f-4e12-90be-05282a8a7245 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:35.878926 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b9346-ec08-4610-aa5a-7674814e75e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:35.879732 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b9346-ec08-4610-aa5a-7674814e75e4 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:35.880183 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b9346-ec08-4610-aa5a-7674814e75e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:35.880607 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b9346-ec08-4610-aa5a-7674814e75e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:35.881490 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b9346-ec08-4610-aa5a-7674814e75e4 None admin] RBAC: Adding query filter params (role.id=17d0330d6df84d3091d7ef234dfc4e6b, scope.project.id=bbcd0ae183934d41a9caeb3d9450db6e, user.id=3d17e3752b7a4a7facf7de1b529ec751) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:35.881954 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b9346-ec08-4610-aa5a-7674814e75e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:35.883394 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b9346-ec08-4610-aa5a-7674814e75e4 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:35.890636 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 65/124] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Oct 30 00:42:35 2022] GET /identity/v3/role_assignments?user.id=3d17e3752b7a4a7facf7de1b529ec751&scope.project.id=bbcd0ae183934d41a9caeb3d9450db6e&role.id=17d0330d6df84d3091d7ef234dfc4e6b => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:35.891271 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b9346-ec08-4610-aa5a-7674814e75e4 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:35.915153 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 60/125] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Oct 30 00:42:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:42:35.916084 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b215dec-cf31-45eb-931a-ead9f1dd26c4 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:35.961492 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:35.976698 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:36.031330 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b9346-ec08-4610-aa5a-7674814e75e4 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:36.059286 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b215dec-cf31-45eb-931a-ead9f1dd26c4 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:36.077078 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a24f75-3827-4eee-b9d2-90174b8ffb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:36.078396 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a24f75-3827-4eee-b9d2-90174b8ffb4b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:36.078822 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a24f75-3827-4eee-b9d2-90174b8ffb4b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:36.079433 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a24f75-3827-4eee-b9d2-90174b8ffb4b None admin] PATH_INFO: `/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:36.081138 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a24f75-3827-4eee-b9d2-90174b8ffb4b None admin] RBAC: Authorizing `identity:get_project(project_id=bbcd0ae183934d41a9caeb3d9450db6e)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:36.083065 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a24f75-3827-4eee-b9d2-90174b8ffb4b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:36.084879 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 66/126] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Oct 30 00:42:35 2022] GET /identity/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:36.086359 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3ef2f-b606-4e1e-a2f4-bcc5d80e1ce1 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:36.086646 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3ef2f-b606-4e1e-a2f4-bcc5d80e1ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:36.086925 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3ef2f-b606-4e1e-a2f4-bcc5d80e1ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:36.109135 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-40d3ef2f-b606-4e1e-a2f4-bcc5d80e1ce1 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:36.109447 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60766f-ddf1-4c62-8400-f341b298a123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:36.109993 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60766f-ddf1-4c62-8400-f341b298a123 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:36.110270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60766f-ddf1-4c62-8400-f341b298a123 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:36.110376 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-40d3ef2f-b606-4e1e-a2f4-bcc5d80e1ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:36.110544 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60766f-ddf1-4c62-8400-f341b298a123 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:36.111260 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60766f-ddf1-4c62-8400-f341b298a123 None admin] RBAC: Adding query filter params (role.id=a2f2dde26304402eb433d8d8cfaca1e7, scope.project.id=751220a24696458b8f48b6846c09cb74, user.id=bcee6ba45b114c7895de9db68a7a8696) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:36.111565 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60766f-ddf1-4c62-8400-f341b298a123 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:36.113010 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60766f-ddf1-4c62-8400-f341b298a123 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:36.119199 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 61/127] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Oct 30 00:42:35 2022] GET /identity/v3/role_assignments?user.id=bcee6ba45b114c7895de9db68a7a8696&scope.project.id=751220a24696458b8f48b6846c09cb74&role.id=a2f2dde26304402eb433d8d8cfaca1e7 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:36.119806 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60766f-ddf1-4c62-8400-f341b298a123 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:36.205819 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 67/128] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:42:36.206740 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3ef2f-b606-4e1e-a2f4-bcc5d80e1ce1 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:36.246948 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:36.256076 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60766f-ddf1-4c62-8400-f341b298a123 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:36.299889 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664f514-9466-4317-abd8-07e961fb0884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:36.300843 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664f514-9466-4317-abd8-07e961fb0884 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:36.301142 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664f514-9466-4317-abd8-07e961fb0884 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:36.301479 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664f514-9466-4317-abd8-07e961fb0884 None admin] PATH_INFO: `/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:36.302055 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:36.302872 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664f514-9466-4317-abd8-07e961fb0884 None admin] RBAC: Authorizing `identity:get_project(project_id=bbcd0ae183934d41a9caeb3d9450db6e)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:36.305374 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664f514-9466-4317-abd8-07e961fb0884 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:36.307112 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 62/129] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Oct 30 00:42:36 2022] GET /identity/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:36.318297 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664f514-9466-4317-abd8-07e961fb0884 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:36.389455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3ef2f-b606-4e1e-a2f4-bcc5d80e1ce1 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:36.435784 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095eab5-5f90-4e7b-813c-0e24ddbfe9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:36.436466 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095eab5-5f90-4e7b-813c-0e24ddbfe9a8 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:36.436752 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095eab5-5f90-4e7b-813c-0e24ddbfe9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:36.437028 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095eab5-5f90-4e7b-813c-0e24ddbfe9a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:36.437817 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095eab5-5f90-4e7b-813c-0e24ddbfe9a8 None admin] RBAC: Adding query filter params (role.id=a2f2dde26304402eb433d8d8cfaca1e7, scope.project.id=bbcd0ae183934d41a9caeb3d9450db6e, user.id=bcee6ba45b114c7895de9db68a7a8696) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:36.438126 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095eab5-5f90-4e7b-813c-0e24ddbfe9a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:36.439578 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095eab5-5f90-4e7b-813c-0e24ddbfe9a8 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:36.447526 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 68/130] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Oct 30 00:42:36 2022] GET /identity/v3/role_assignments?user.id=bcee6ba45b114c7895de9db68a7a8696&scope.project.id=bbcd0ae183934d41a9caeb3d9450db6e&role.id=a2f2dde26304402eb433d8d8cfaca1e7 => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:36.471854 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664f514-9466-4317-abd8-07e961fb0884 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:36.510274 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75a0b2-d087-4ae7-9afd-714bca86cf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:36.510905 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75a0b2-d087-4ae7-9afd-714bca86cf26 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:36.511183 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75a0b2-d087-4ae7-9afd-714bca86cf26 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:36.511453 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75a0b2-d087-4ae7-9afd-714bca86cf26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:36.512200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75a0b2-d087-4ae7-9afd-714bca86cf26 None admin] RBAC: Adding query filter params (role.id=b63857cb2ff04d189523309091368e81, scope.project.id=bbcd0ae183934d41a9caeb3d9450db6e, user.id=bcee6ba45b114c7895de9db68a7a8696) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:36.512510 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75a0b2-d087-4ae7-9afd-714bca86cf26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:36.514113 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75a0b2-d087-4ae7-9afd-714bca86cf26 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:36.521161 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 63/131] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Oct 30 00:42:36 2022] GET /identity/v3/role_assignments?user.id=bcee6ba45b114c7895de9db68a7a8696&scope.project.id=bbcd0ae183934d41a9caeb3d9450db6e&role.id=b63857cb2ff04d189523309091368e81 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:36.549268 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095eab5-5f90-4e7b-813c-0e24ddbfe9a8 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:36.674028 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095eab5-5f90-4e7b-813c-0e24ddbfe9a8 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:36.708220 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:36.715134 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e04f5-a11e-4e82-82dc-fc0a4f41cfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:36.716591 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e04f5-a11e-4e82-82dc-fc0a4f41cfbb None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:36.716872 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e04f5-a11e-4e82-82dc-fc0a4f41cfbb None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:36.717145 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e04f5-a11e-4e82-82dc-fc0a4f41cfbb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:36.718405 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e04f5-a11e-4e82-82dc-fc0a4f41cfbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:36.719878 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e04f5-a11e-4e82-82dc-fc0a4f41cfbb None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:36.721493 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 69/132] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:42:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:36.727181 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75a0b2-d087-4ae7-9afd-714bca86cf26 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:36.760602 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:36.838778 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75a0b2-d087-4ae7-9afd-714bca86cf26 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:36.871109 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097cbd0-8633-44d4-9c41-c47b6fd96b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:36.871710 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097cbd0-8633-44d4-9c41-c47b6fd96b0a None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:36.871991 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097cbd0-8633-44d4-9c41-c47b6fd96b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:36.872804 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097cbd0-8633-44d4-9c41-c47b6fd96b0a None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:36.873484 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097cbd0-8633-44d4-9c41-c47b6fd96b0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:36.874922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097cbd0-8633-44d4-9c41-c47b6fd96b0a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:36.902826 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 64/133] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Oct 30 00:42:36 2022] POST /identity/v3/users => generated 283 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:42:37.301639 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13acf9-a32e-4a6f-b6e1-dd94dddff008 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:37.302179 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13acf9-a32e-4a6f-b6e1-dd94dddff008 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:37.302179 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13acf9-a32e-4a6f-b6e1-dd94dddff008 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:37.303538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 70/134] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:37.309224 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151a125-a6d9-4af9-8a1a-db9e78db3854 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:37.309719 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151a125-a6d9-4af9-8a1a-db9e78db3854 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:37.310497 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151a125-a6d9-4af9-8a1a-db9e78db3854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:37.329825 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-4151a125-a6d9-4af9-8a1a-db9e78db3854 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:37.331338 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-4151a125-a6d9-4af9-8a1a-db9e78db3854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:37.404497 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 65/135] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:42:37.676517 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13acf9-a32e-4a6f-b6e1-dd94dddff008 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:37.784301 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13acf9-a32e-4a6f-b6e1-dd94dddff008 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:37.820440 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be871c6-f15a-4f81-9f90-706cd00ccc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:37.821477 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be871c6-f15a-4f81-9f90-706cd00ccc14 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:37.821967 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be871c6-f15a-4f81-9f90-706cd00ccc14 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:37.822475 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be871c6-f15a-4f81-9f90-706cd00ccc14 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:37.835019 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be871c6-f15a-4f81-9f90-706cd00ccc14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:42:37.840634 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-2be871c6-f15a-4f81-9f90-706cd00ccc14 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:42:37.840634 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:37.840634 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:42:37.840634 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:42:37.840634 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:42:37.840634 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:42:37.840634 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:42:37.840634 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:42:37.840634 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:42:37.840634 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:42:37.840634 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:42:37.840634 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:42:37.840634 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:42:37.840634 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:42:37.840634 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:42:37.840634 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:42:37.841548 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:42:37.841548 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:42:37.841548 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:42:37.841548 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:42:37.841548 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:42:37.841548 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:42:37.841548 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:42:37.841548 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:42:37.841548 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:42:37.841548 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:42:37.841548 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:42:37.841548 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:42:37.841548 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:42:37.841548 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:42:37.841548 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:42:37.841548 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:42:37.842321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:42:37.842321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:42:37.842321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:42:37.842321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:42:37.842321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:42:37.842321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:42:37.842321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:42:37.842321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:42:37.842321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:42:37.842321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:42:37.842321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:42:37.842321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:42:37.844545 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 71/136] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:42:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:42:37.850784 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151a125-a6d9-4af9-8a1a-db9e78db3854 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:37.865895 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:37.957888 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151a125-a6d9-4af9-8a1a-db9e78db3854 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:37.992488 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17e2aa-047e-45aa-9270-39e19f0a0dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:37.993095 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17e2aa-047e-45aa-9270-39e19f0a0dbc None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:37.993404 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17e2aa-047e-45aa-9270-39e19f0a0dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:37.993679 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17e2aa-047e-45aa-9270-39e19f0a0dbc None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:37.994341 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17e2aa-047e-45aa-9270-39e19f0a0dbc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:37.994642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17e2aa-047e-45aa-9270-39e19f0a0dbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:37.996023 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17e2aa-047e-45aa-9270-39e19f0a0dbc None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:38.005934 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 66/137] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Oct 30 00:42:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:38.011758 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be871c6-f15a-4f81-9f90-706cd00ccc14 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:38.068677 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:38.120246 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be871c6-f15a-4f81-9f90-706cd00ccc14 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:38.155739 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4273fc4-afe2-4baf-a1d4-d0cf72066192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:38.156373 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4273fc4-afe2-4baf-a1d4-d0cf72066192 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:38.156652 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4273fc4-afe2-4baf-a1d4-d0cf72066192 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:38.156928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4273fc4-afe2-4baf-a1d4-d0cf72066192 None admin] PATH_INFO: `/v3/users/3a0e71a80d964fcc805cb21322add85a` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:38.158072 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4273fc4-afe2-4baf-a1d4-d0cf72066192 None admin] RBAC: Authorizing `identity:get_user(user_id=3a0e71a80d964fcc805cb21322add85a)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:38.159516 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4273fc4-afe2-4baf-a1d4-d0cf72066192 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:38.161077 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 72/138] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:42:38 2022] GET /identity/v3/users/3a0e71a80d964fcc805cb21322add85a => generated 289 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:38.166644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17e2aa-047e-45aa-9270-39e19f0a0dbc None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:38.246539 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:38.270007 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17e2aa-047e-45aa-9270-39e19f0a0dbc None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:38.304949 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964cc6c-e6f9-41f3-8ef5-b755126c79ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:38.305583 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964cc6c-e6f9-41f3-8ef5-b755126c79ed None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:38.305863 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964cc6c-e6f9-41f3-8ef5-b755126c79ed None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:38.306138 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964cc6c-e6f9-41f3-8ef5-b755126c79ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:38.377149 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964cc6c-e6f9-41f3-8ef5-b755126c79ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:38.378661 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964cc6c-e6f9-41f3-8ef5-b755126c79ed None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:38.452300 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:38.485769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 67/139] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Oct 30 00:42:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:42:38.491043 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4273fc4-afe2-4baf-a1d4-d0cf72066192 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:38.591929 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4273fc4-afe2-4baf-a1d4-d0cf72066192 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:38.614096 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:38.626228 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba0f76-2cdb-49df-b38f-fc96195c386f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:38.626856 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba0f76-2cdb-49df-b38f-fc96195c386f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:38.627133 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba0f76-2cdb-49df-b38f-fc96195c386f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:38.627406 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba0f76-2cdb-49df-b38f-fc96195c386f None admin] PATH_INFO: `/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:38.628524 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba0f76-2cdb-49df-b38f-fc96195c386f None admin] RBAC: Authorizing `identity:get_project(project_id=bbcd0ae183934d41a9caeb3d9450db6e)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:38.629992 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba0f76-2cdb-49df-b38f-fc96195c386f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:38.631905 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 73/140] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Oct 30 00:42:38 2022] GET /identity/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:38.638237 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964cc6c-e6f9-41f3-8ef5-b755126c79ed None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:38.746069 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964cc6c-e6f9-41f3-8ef5-b755126c79ed None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:38.782590 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68fe63-58a2-411e-b20b-7f6b08ca10a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:38.783199 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68fe63-58a2-411e-b20b-7f6b08ca10a1 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:38.783477 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68fe63-58a2-411e-b20b-7f6b08ca10a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:38.783749 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68fe63-58a2-411e-b20b-7f6b08ca10a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:38.784554 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68fe63-58a2-411e-b20b-7f6b08ca10a1 None admin] RBAC: Adding query filter params (role.id=bb8d5dabb95e46ef8120c17cbcca0566, scope.project.id=bbcd0ae183934d41a9caeb3d9450db6e, user.id=3a0e71a80d964fcc805cb21322add85a) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:38.784865 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68fe63-58a2-411e-b20b-7f6b08ca10a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:38.786398 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68fe63-58a2-411e-b20b-7f6b08ca10a1 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:38.792375 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 68/141] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Oct 30 00:42:38 2022] GET /identity/v3/role_assignments?user.id=3a0e71a80d964fcc805cb21322add85a&scope.project.id=bbcd0ae183934d41a9caeb3d9450db6e&role.id=bb8d5dabb95e46ef8120c17cbcca0566 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:39.249982 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fca05-d591-496b-9f72-b26d8b41f26c None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:39.250222 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fca05-d591-496b-9f72-b26d8b41f26c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:39.250495 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fca05-d591-496b-9f72-b26d8b41f26c None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:39.252092 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 74/142] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:39.257786 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80009cea-c47c-4cf6-9a8c-dc364e51e700 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:39.258081 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80009cea-c47c-4cf6-9a8c-dc364e51e700 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:39.258361 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80009cea-c47c-4cf6-9a8c-dc364e51e700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:39.276870 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-80009cea-c47c-4cf6-9a8c-dc364e51e700 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:39.278092 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-80009cea-c47c-4cf6-9a8c-dc364e51e700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:39.314309 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:39.326227 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75306d5e-1a97-4da7-aa0f-53cf38fef5ec None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:39.326500 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75306d5e-1a97-4da7-aa0f-53cf38fef5ec None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:39.326935 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75306d5e-1a97-4da7-aa0f-53cf38fef5ec None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:39.328325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 75/143] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:39.334211 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52098b49-1772-4828-be68-5db93da006c0 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:39.334496 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52098b49-1772-4828-be68-5db93da006c0 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:39.335043 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52098b49-1772-4828-be68-5db93da006c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:39.353000 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-52098b49-1772-4828-be68-5db93da006c0 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:39.354214 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-52098b49-1772-4828-be68-5db93da006c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:39.355899 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 69/144] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:42:39.421536 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 76/145] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:42:39.432538 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea132c-997f-4ef1-b8e6-e1fa1ccacc6a None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:39.432990 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea132c-997f-4ef1-b8e6-e1fa1ccacc6a None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:39.433065 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea132c-997f-4ef1-b8e6-e1fa1ccacc6a None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:39.434550 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 70/146] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:39.439419 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18326e91-e46b-4779-bae3-c474d1814b5a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:39.439707 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18326e91-e46b-4779-bae3-c474d1814b5a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:39.439979 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18326e91-e46b-4779-bae3-c474d1814b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:39.458241 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-18326e91-e46b-4779-bae3-c474d1814b5a None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:39.459402 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-18326e91-e46b-4779-bae3-c474d1814b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:39.524593 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 77/147] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:42:39.621834 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea132c-997f-4ef1-b8e6-e1fa1ccacc6a None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:39.692114 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18326e91-e46b-4779-bae3-c474d1814b5a None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:39.731418 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea132c-997f-4ef1-b8e6-e1fa1ccacc6a None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:39.752879 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:39.766849 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e7132-880e-42ed-9efa-afb60649340f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:39.767469 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e7132-880e-42ed-9efa-afb60649340f None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:39.767746 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e7132-880e-42ed-9efa-afb60649340f None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:39.768026 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e7132-880e-42ed-9efa-afb60649340f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:39.781658 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e7132-880e-42ed-9efa-afb60649340f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:42:39.787321 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-dd8e7132-880e-42ed-9efa-afb60649340f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:42:39.787321 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:39.787321 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:42:39.787321 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:42:39.787321 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:42:39.787321 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:42:39.787321 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:42:39.787321 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:42:39.787321 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:42:39.787321 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:42:39.787321 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:42:39.787321 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:42:39.787321 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:42:39.787321 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:42:39.787321 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:42:39.787321 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:42:39.788189 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:42:39.788189 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:42:39.788189 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:42:39.788189 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:42:39.788189 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:42:39.788189 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:42:39.788189 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:42:39.788189 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:42:39.788189 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:42:39.788189 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:42:39.788189 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:42:39.788189 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:42:39.788189 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:42:39.788189 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:42:39.788189 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:42:39.788189 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:42:39.788957 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:42:39.788957 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:42:39.788957 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:42:39.788957 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:42:39.788957 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:42:39.788957 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:42:39.788957 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:42:39.788957 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:42:39.788957 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:42:39.788957 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:42:39.788957 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:42:39.788957 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:42:39.789764 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 71/148] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Oct 30 00:42:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:42:39.791873 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e7132-880e-42ed-9efa-afb60649340f None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:39.809271 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18326e91-e46b-4779-bae3-c474d1814b5a None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:39.820178 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:39.843987 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a5d08-b8a6-45c3-b842-76ac8b73e979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:39.844605 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a5d08-b8a6-45c3-b842-76ac8b73e979 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:39.844877 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a5d08-b8a6-45c3-b842-76ac8b73e979 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:39.845145 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a5d08-b8a6-45c3-b842-76ac8b73e979 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:39.855251 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a5d08-b8a6-45c3-b842-76ac8b73e979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:42:39.860014 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-271a5d08-b8a6-45c3-b842-76ac8b73e979 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:42:39.860014 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:39.860014 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:42:39.860014 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:42:39.860014 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:42:39.860014 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:42:39.860014 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:42:39.860014 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:42:39.860014 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:42:39.860014 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:42:39.860014 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:42:39.860014 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:42:39.860014 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:42:39.860014 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:42:39.860014 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:42:39.860014 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:42:39.860890 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:42:39.860890 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:42:39.860890 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:42:39.860890 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:42:39.860890 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:42:39.860890 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:42:39.860890 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:42:39.860890 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:42:39.860890 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:42:39.860890 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:42:39.860890 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:42:39.860890 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:42:39.860890 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:42:39.860890 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:42:39.860890 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:42:39.860890 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:42:39.861709 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:42:39.861709 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:42:39.861709 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:42:39.861709 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:42:39.861709 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:42:39.861709 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:42:39.861709 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:42:39.861709 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:42:39.861709 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:42:39.861709 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:42:39.861709 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:42:39.861709 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:42:39.861709 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 78/149] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Oct 30 00:42:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:42:39.862338 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a5d08-b8a6-45c3-b842-76ac8b73e979 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:39.894296 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e7132-880e-42ed-9efa-afb60649340f None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:39.927544 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca637360-777f-4354-bd57-b9a0295f2e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:39.928162 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca637360-777f-4354-bd57-b9a0295f2e82 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:39.928441 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca637360-777f-4354-bd57-b9a0295f2e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:39.928713 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca637360-777f-4354-bd57-b9a0295f2e82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:39.930485 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca637360-777f-4354-bd57-b9a0295f2e82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:39.931936 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca637360-777f-4354-bd57-b9a0295f2e82 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:39.933499 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 72/150] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:42:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:42:39.936566 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca637360-777f-4354-bd57-b9a0295f2e82 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:39.958854 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a5d08-b8a6-45c3-b842-76ac8b73e979 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:39.969127 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:39.992398 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d7d93-5348-4f03-a935-a83000220702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:39.993047 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d7d93-5348-4f03-a935-a83000220702 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:39.993353 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d7d93-5348-4f03-a935-a83000220702 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:39.993654 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d7d93-5348-4f03-a935-a83000220702 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:39.994309 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d7d93-5348-4f03-a935-a83000220702 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:39.994606 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d7d93-5348-4f03-a935-a83000220702 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:39.995983 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d7d93-5348-4f03-a935-a83000220702 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:40.004354 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 79/151] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:42:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:40.009074 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d7d93-5348-4f03-a935-a83000220702 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:40.033115 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:40.039234 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca637360-777f-4354-bd57-b9a0295f2e82 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:40.072401 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa40088-c048-41f0-9f3c-7cbf0620e3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:40.072997 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa40088-c048-41f0-9f3c-7cbf0620e3a7 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:40.073305 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa40088-c048-41f0-9f3c-7cbf0620e3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:40.073577 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa40088-c048-41f0-9f3c-7cbf0620e3a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:40.074230 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa40088-c048-41f0-9f3c-7cbf0620e3a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:40.074529 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa40088-c048-41f0-9f3c-7cbf0620e3a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:40.076474 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa40088-c048-41f0-9f3c-7cbf0620e3a7 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:40.084146 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 73/152] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:42:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:40.084915 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa40088-c048-41f0-9f3c-7cbf0620e3a7 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:40.104925 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d7d93-5348-4f03-a935-a83000220702 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:40.138244 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813023b6-19e1-40dc-aa33-54149a248141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:40.138847 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813023b6-19e1-40dc-aa33-54149a248141 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:40.139121 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813023b6-19e1-40dc-aa33-54149a248141 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:40.139395 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813023b6-19e1-40dc-aa33-54149a248141 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:40.140031 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813023b6-19e1-40dc-aa33-54149a248141 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:40.141486 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813023b6-19e1-40dc-aa33-54149a248141 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:40.163158 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 80/153] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Oct 30 00:42:40 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:42:40.164054 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813023b6-19e1-40dc-aa33-54149a248141 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:40.188783 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa40088-c048-41f0-9f3c-7cbf0620e3a7 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:40.194753 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:40.234843 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63427f10-4cbc-4b61-96d8-3f8027297134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:40.235850 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63427f10-4cbc-4b61-96d8-3f8027297134 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:40.236130 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63427f10-4cbc-4b61-96d8-3f8027297134 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:40.236410 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63427f10-4cbc-4b61-96d8-3f8027297134 None admin] PATH_INFO: `/v3/users/51efaa4403f84bb4944ad9854112e989` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:40.252864 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63427f10-4cbc-4b61-96d8-3f8027297134 None admin] RBAC: Authorizing `identity:get_user(user_id=51efaa4403f84bb4944ad9854112e989)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:40.254623 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63427f10-4cbc-4b61-96d8-3f8027297134 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:40.256611 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 74/154] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:42:40 2022] GET /identity/v3/users/51efaa4403f84bb4944ad9854112e989 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:40.262100 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63427f10-4cbc-4b61-96d8-3f8027297134 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:40.279112 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813023b6-19e1-40dc-aa33-54149a248141 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:40.284088 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:40.315752 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5a3bc-bea6-43ed-85e0-186efce56c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:40.316402 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5a3bc-bea6-43ed-85e0-186efce56c3e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:40.316679 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5a3bc-bea6-43ed-85e0-186efce56c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:40.316960 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5a3bc-bea6-43ed-85e0-186efce56c3e None admin] PATH_INFO: `/v3/users/51efaa4403f84bb4944ad9854112e989` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:40.318172 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b5a3bc-bea6-43ed-85e0-186efce56c3e None admin] RBAC: Authorizing `identity:get_user(user_id=51efaa4403f84bb4944ad9854112e989)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:40.319650 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b5a3bc-bea6-43ed-85e0-186efce56c3e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:40.321523 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 81/155] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:42:40 2022] GET /identity/v3/users/51efaa4403f84bb4944ad9854112e989 => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:40.327601 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5a3bc-bea6-43ed-85e0-186efce56c3e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:40.378445 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63427f10-4cbc-4b61-96d8-3f8027297134 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:40.424543 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c25aaa-8389-46c3-82fd-f071a27e078f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:40.425648 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c25aaa-8389-46c3-82fd-f071a27e078f None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:40.426145 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c25aaa-8389-46c3-82fd-f071a27e078f None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:40.426674 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c25aaa-8389-46c3-82fd-f071a27e078f None admin] PATH_INFO: `/v3/projects/88c423a2de7d46ff97e231261ac80890` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:40.428036 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c25aaa-8389-46c3-82fd-f071a27e078f None admin] RBAC: Authorizing `identity:get_project(project_id=88c423a2de7d46ff97e231261ac80890)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:40.430028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c25aaa-8389-46c3-82fd-f071a27e078f None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:40.432601 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 75/156] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Oct 30 00:42:40 2022] GET /identity/v3/projects/88c423a2de7d46ff97e231261ac80890 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:42:40.438966 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c25aaa-8389-46c3-82fd-f071a27e078f None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:40.446430 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:40.451888 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5a3bc-bea6-43ed-85e0-186efce56c3e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:40.500332 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cea875-0b1c-433a-be3c-6c03636122cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:40.501082 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cea875-0b1c-433a-be3c-6c03636122cc None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:40.501424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cea875-0b1c-433a-be3c-6c03636122cc None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:40.501694 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cea875-0b1c-433a-be3c-6c03636122cc None admin] PATH_INFO: `/v3/projects/88c423a2de7d46ff97e231261ac80890` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:40.502921 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cea875-0b1c-433a-be3c-6c03636122cc None admin] RBAC: Authorizing `identity:get_project(project_id=88c423a2de7d46ff97e231261ac80890)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:40.504626 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cea875-0b1c-433a-be3c-6c03636122cc None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:40.507509 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 82/157] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Oct 30 00:42:40 2022] GET /identity/v3/projects/88c423a2de7d46ff97e231261ac80890 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:42:40.512738 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cea875-0b1c-433a-be3c-6c03636122cc None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:40.539680 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:40.557347 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c25aaa-8389-46c3-82fd-f071a27e078f None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:40.599644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44c3e6-c5bb-496d-b7b5-1d8b2ad59680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:40.600802 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44c3e6-c5bb-496d-b7b5-1d8b2ad59680 None admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:40.601139 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44c3e6-c5bb-496d-b7b5-1d8b2ad59680 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:40.601731 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44c3e6-c5bb-496d-b7b5-1d8b2ad59680 None admin] PATH_INFO: `/v3/projects/88c423a2de7d46ff97e231261ac80890/users/51efaa4403f84bb4944ad9854112e989/roles/17d0330d6df84d3091d7ef234dfc4e6b` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:40.603682 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44c3e6-c5bb-496d-b7b5-1d8b2ad59680 None admin] RBAC: Authorizing `identity:create_grant(project_id=88c423a2de7d46ff97e231261ac80890, user_id=51efaa4403f84bb4944ad9854112e989, role_id=17d0330d6df84d3091d7ef234dfc4e6b)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:40.605210 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44c3e6-c5bb-496d-b7b5-1d8b2ad59680 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:40.625626 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 76/158] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Oct 30 00:42:40 2022] PUT /identity/v3/projects/88c423a2de7d46ff97e231261ac80890/users/51efaa4403f84bb4944ad9854112e989/roles/17d0330d6df84d3091d7ef234dfc4e6b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:42:40.645003 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cea875-0b1c-433a-be3c-6c03636122cc None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:40.687943 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f059a-4dcd-4ec4-931a-7eba55abb008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:40.688683 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f059a-4dcd-4ec4-931a-7eba55abb008 None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:40.688965 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f059a-4dcd-4ec4-931a-7eba55abb008 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:40.689330 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f059a-4dcd-4ec4-931a-7eba55abb008 None admin] PATH_INFO: `/v3/projects/88c423a2de7d46ff97e231261ac80890/users/51efaa4403f84bb4944ad9854112e989/roles/b63857cb2ff04d189523309091368e81` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:40.691773 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f059a-4dcd-4ec4-931a-7eba55abb008 None admin] RBAC: Authorizing `identity:create_grant(project_id=88c423a2de7d46ff97e231261ac80890, user_id=51efaa4403f84bb4944ad9854112e989, role_id=b63857cb2ff04d189523309091368e81)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:40.693503 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f059a-4dcd-4ec4-931a-7eba55abb008 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:40.711397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 83/159] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Oct 30 00:42:40 2022] PUT /identity/v3/projects/88c423a2de7d46ff97e231261ac80890/users/51efaa4403f84bb4944ad9854112e989/roles/b63857cb2ff04d189523309091368e81 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:42:42.442205 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5447f-5a72-48a6-990b-ca9c487a8d41 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:42.442794 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5447f-5a72-48a6-990b-ca9c487a8d41 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:42.442794 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5447f-5a72-48a6-990b-ca9c487a8d41 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:42.444315 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 77/160] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:42.450060 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762dde8-eec5-4104-b10e-d72cd664f27e None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:42.451127 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762dde8-eec5-4104-b10e-d72cd664f27e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:42.451127 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762dde8-eec5-4104-b10e-d72cd664f27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:42.471730 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-0762dde8-eec5-4104-b10e-d72cd664f27e None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:42.472929 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0762dde8-eec5-4104-b10e-d72cd664f27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:42.493385 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:42.547168 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 84/161] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:42:42.563252 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c75928-ad9b-48a5-a091-ba31906cbf93 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:42.563531 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c75928-ad9b-48a5-a091-ba31906cbf93 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:42.563804 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c75928-ad9b-48a5-a091-ba31906cbf93 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:42.565411 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 78/162] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:42.570591 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1e25a-1f76-4c05-891f-62330e32145b None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:42.571035 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1e25a-1f76-4c05-891f-62330e32145b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:42.571446 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1e25a-1f76-4c05-891f-62330e32145b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:42.590001 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-ccb1e25a-1f76-4c05-891f-62330e32145b None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:42.592109 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ccb1e25a-1f76-4c05-891f-62330e32145b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:42.658165 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 85/163] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:42:42.820836 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c75928-ad9b-48a5-a091-ba31906cbf93 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:42.843129 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9ab5f-9c3f-4f93-9f2a-68ae43d33ad6 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:42.843407 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9ab5f-9c3f-4f93-9f2a-68ae43d33ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:42.843678 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9ab5f-9c3f-4f93-9f2a-68ae43d33ad6 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:42.845151 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 86/164] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:42.850284 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781908c-cb89-4827-98e6-52f0f59d8d19 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:42.850679 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781908c-cb89-4827-98e6-52f0f59d8d19 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:42.850953 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781908c-cb89-4827-98e6-52f0f59d8d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:42.869871 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-e781908c-cb89-4827-98e6-52f0f59d8d19 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:42.871271 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e781908c-cb89-4827-98e6-52f0f59d8d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:42.927560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c75928-ad9b-48a5-a091-ba31906cbf93 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:42.943996 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 87/165] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:42:42.944839 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781908c-cb89-4827-98e6-52f0f59d8d19 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:42.964203 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:42.965038 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6da28-f5f1-4d1b-973c-c93f876a0de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:42.965553 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6da28-f5f1-4d1b-973c-c93f876a0de1 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:42.965910 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6da28-f5f1-4d1b-973c-c93f876a0de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:42.966267 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6da28-f5f1-4d1b-973c-c93f876a0de1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:42.976375 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6da28-f5f1-4d1b-973c-c93f876a0de1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:42:42.981133 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-19a6da28-f5f1-4d1b-973c-c93f876a0de1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:42:42.981133 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:42.981133 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:42:42.981133 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:42:42.981133 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:42:42.981133 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:42:42.981133 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:42:42.981133 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:42:42.981133 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:42:42.981133 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:42:42.981133 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:42:42.981133 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:42:42.981133 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:42:42.981133 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:42:42.981133 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:42:42.981133 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:42:42.982207 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:42:42.982207 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:42:42.982207 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:42:42.982207 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:42:42.982207 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:42:42.982207 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:42:42.982207 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:42:42.982207 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:42:42.982207 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:42:42.982207 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:42:42.982207 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:42:42.982207 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:42:42.982207 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:42:42.982207 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:42:42.982207 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:42:42.982207 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:42:42.983425 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:42:42.983425 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:42:42.983425 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:42:42.983425 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:42:42.983425 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:42:42.983425 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:42:42.983425 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:42:42.983425 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:42:42.983425 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:42:42.983425 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:42:42.983425 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:42:42.983425 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:42:42.983425 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 79/166] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:42:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:42:42.986690 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db42487-e23e-42fd-bd7e-733c7a7e041a None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:42.987091 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db42487-e23e-42fd-bd7e-733c7a7e041a None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:42.987395 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db42487-e23e-42fd-bd7e-733c7a7e041a None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:42.989172 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 80/167] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:42.994069 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db42487-e23e-42fd-bd7e-733c7a7e041a None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:42.999000 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:43.065740 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781908c-cb89-4827-98e6-52f0f59d8d19 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:43.100199 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db42487-e23e-42fd-bd7e-733c7a7e041a None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:43.101068 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246df7b-077e-46cb-a990-a02758112557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:43.101726 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246df7b-077e-46cb-a990-a02758112557 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:43.102013 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246df7b-077e-46cb-a990-a02758112557 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:43.102286 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246df7b-077e-46cb-a990-a02758112557 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:43.103387 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246df7b-077e-46cb-a990-a02758112557 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:43.104826 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246df7b-077e-46cb-a990-a02758112557 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:43.106937 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 88/168] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:42:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:43.108154 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15d6c5-bb54-45e5-8748-e73c84b47b9e None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:43.108339 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15d6c5-bb54-45e5-8748-e73c84b47b9e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:43.108568 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15d6c5-bb54-45e5-8748-e73c84b47b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:43.127580 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-9c15d6c5-bb54-45e5-8748-e73c84b47b9e None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:43.128749 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9c15d6c5-bb54-45e5-8748-e73c84b47b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:43.137414 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346060f-7604-4239-a0fa-b2c438cf67d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:43.138590 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346060f-7604-4239-a0fa-b2c438cf67d5 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:43.138873 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346060f-7604-4239-a0fa-b2c438cf67d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:43.139144 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346060f-7604-4239-a0fa-b2c438cf67d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:43.139794 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346060f-7604-4239-a0fa-b2c438cf67d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:43.140094 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346060f-7604-4239-a0fa-b2c438cf67d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:43.141483 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346060f-7604-4239-a0fa-b2c438cf67d5 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:43.149655 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 81/169] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Oct 30 00:42:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:43.155431 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346060f-7604-4239-a0fa-b2c438cf67d5 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:43.199167 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 89/170] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:42:43.200716 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15d6c5-bb54-45e5-8748-e73c84b47b9e None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:43.223609 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:43.230648 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:43.270787 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346060f-7604-4239-a0fa-b2c438cf67d5 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:43.316090 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460f94c-feb1-46f1-a949-cd7e4891992e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:43.316680 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460f94c-feb1-46f1-a949-cd7e4891992e None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:43.316951 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460f94c-feb1-46f1-a949-cd7e4891992e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:43.317233 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460f94c-feb1-46f1-a949-cd7e4891992e None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:43.317871 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460f94c-feb1-46f1-a949-cd7e4891992e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:43.319305 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460f94c-feb1-46f1-a949-cd7e4891992e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:43.320213 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15d6c5-bb54-45e5-8748-e73c84b47b9e None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:43.341376 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 82/171] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Oct 30 00:42:43 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:42:43.342189 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460f94c-feb1-46f1-a949-cd7e4891992e None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:43.371339 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6818a-e65c-4228-9727-a2861f97a52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:43.372595 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6818a-e65c-4228-9727-a2861f97a52a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:43.373076 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6818a-e65c-4228-9727-a2861f97a52a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:43.373591 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6818a-e65c-4228-9727-a2861f97a52a None admin] PATH_INFO: `/v3/users/fbf1e1af2a7643e98d0d9ad60a3d7650` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:43.391771 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6818a-e65c-4228-9727-a2861f97a52a None admin] RBAC: Authorizing `identity:get_user(user_id=fbf1e1af2a7643e98d0d9ad60a3d7650)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:43.393883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6818a-e65c-4228-9727-a2861f97a52a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:43.396465 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 90/172] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:42:43 2022] GET /identity/v3/users/fbf1e1af2a7643e98d0d9ad60a3d7650 => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:43.405303 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6818a-e65c-4228-9727-a2861f97a52a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:43.456807 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460f94c-feb1-46f1-a949-cd7e4891992e None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:43.480862 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:43.484917 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:43.495119 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c074b-7cdf-4e75-a5f2-5d7ff2dff1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:43.495752 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c074b-7cdf-4e75-a5f2-5d7ff2dff1f5 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:43.496026 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c074b-7cdf-4e75-a5f2-5d7ff2dff1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:43.496292 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c074b-7cdf-4e75-a5f2-5d7ff2dff1f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:43.508550 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c074b-7cdf-4e75-a5f2-5d7ff2dff1f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:42:43.514159 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-f77c074b-7cdf-4e75-a5f2-5d7ff2dff1f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:42:43.514159 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:43.514159 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:42:43.514159 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:42:43.514159 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:42:43.514159 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:42:43.514159 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:42:43.514159 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:42:43.514159 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:42:43.514159 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:42:43.514159 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:42:43.514159 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:42:43.514159 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:42:43.514159 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:42:43.514159 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:42:43.514159 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:42:43.515406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:42:43.515406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:42:43.515406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:42:43.515406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:42:43.515406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:42:43.515406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:42:43.515406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:42:43.515406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:42:43.515406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:42:43.515406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:42:43.515406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:42:43.515406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:42:43.515406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:42:43.515406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:42:43.515406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:42:43.515406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:42:43.516200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:42:43.516200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:42:43.516200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:42:43.516200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:42:43.516200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:42:43.516200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:42:43.516200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:42:43.516200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:42:43.516200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:42:43.516200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:42:43.516200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:42:43.516200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:42:43.516200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 83/173] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Oct 30 00:42:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:42:43.519312 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c074b-7cdf-4e75-a5f2-5d7ff2dff1f5 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:43.527271 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6818a-e65c-4228-9727-a2861f97a52a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:43.566099 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02076a6f-9925-4898-8c3e-682142c67382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:43.566751 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02076a6f-9925-4898-8c3e-682142c67382 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:43.567027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02076a6f-9925-4898-8c3e-682142c67382 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:43.567297 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02076a6f-9925-4898-8c3e-682142c67382 None admin] PATH_INFO: `/v3/projects/88c423a2de7d46ff97e231261ac80890` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:43.568422 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02076a6f-9925-4898-8c3e-682142c67382 None admin] RBAC: Authorizing `identity:get_project(project_id=88c423a2de7d46ff97e231261ac80890)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:43.572599 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02076a6f-9925-4898-8c3e-682142c67382 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:43.572599 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 91/174] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Oct 30 00:42:43 2022] GET /identity/v3/projects/88c423a2de7d46ff97e231261ac80890 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:43.573567 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02076a6f-9925-4898-8c3e-682142c67382 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:43.638575 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c074b-7cdf-4e75-a5f2-5d7ff2dff1f5 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:43.683545 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1feabc-c4b1-43bd-80e9-b294935d2a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:43.684203 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1feabc-c4b1-43bd-80e9-b294935d2a6e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:43.685497 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1feabc-c4b1-43bd-80e9-b294935d2a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:43.686018 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1feabc-c4b1-43bd-80e9-b294935d2a6e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:43.699400 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02076a6f-9925-4898-8c3e-682142c67382 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:43.701442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1feabc-c4b1-43bd-80e9-b294935d2a6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:42:43.707562 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-9c1feabc-c4b1-43bd-80e9-b294935d2a6e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:42:43.707562 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:43.707562 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:42:43.707562 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:42:43.707562 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:42:43.707562 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:42:43.707562 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:42:43.707562 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:42:43.707562 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:42:43.707562 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:42:43.707562 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:42:43.707562 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:42:43.707562 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:42:43.707562 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:42:43.707562 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:42:43.707562 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:42:43.708578 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:42:43.708578 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:42:43.708578 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:42:43.708578 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:42:43.708578 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:42:43.708578 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:42:43.708578 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:42:43.708578 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:42:43.708578 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:42:43.708578 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:42:43.708578 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:42:43.708578 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:42:43.708578 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:42:43.708578 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:42:43.708578 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:42:43.708578 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:42:43.709629 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:42:43.709629 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:42:43.709629 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:42:43.709629 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:42:43.709629 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:42:43.709629 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:42:43.709629 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:42:43.709629 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:42:43.709629 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:42:43.709629 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:42:43.709629 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:42:43.709629 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:42:43.711737 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 84/175] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Oct 30 00:42:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:42:43.711737 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1feabc-c4b1-43bd-80e9-b294935d2a6e None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:43.743034 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409920c3-11cd-4e74-835b-52ea219d7e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:43.744273 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409920c3-11cd-4e74-835b-52ea219d7e4a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:43.744650 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409920c3-11cd-4e74-835b-52ea219d7e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:43.745032 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409920c3-11cd-4e74-835b-52ea219d7e4a None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:43.745822 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409920c3-11cd-4e74-835b-52ea219d7e4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:43.746125 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409920c3-11cd-4e74-835b-52ea219d7e4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:43.748053 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409920c3-11cd-4e74-835b-52ea219d7e4a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:43.754078 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:43.758543 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 92/176] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:42:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:43.759367 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409920c3-11cd-4e74-835b-52ea219d7e4a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:43.782960 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:43.845526 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1feabc-c4b1-43bd-80e9-b294935d2a6e None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:43.882762 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118bd8e-c867-4452-9d05-62ca1d3dce57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:43.883578 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118bd8e-c867-4452-9d05-62ca1d3dce57 None admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:43.883991 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118bd8e-c867-4452-9d05-62ca1d3dce57 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:43.884336 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118bd8e-c867-4452-9d05-62ca1d3dce57 None admin] PATH_INFO: `/v3/projects/88c423a2de7d46ff97e231261ac80890/users/fbf1e1af2a7643e98d0d9ad60a3d7650/roles/a2f2dde26304402eb433d8d8cfaca1e7` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:43.886443 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118bd8e-c867-4452-9d05-62ca1d3dce57 None admin] RBAC: Authorizing `identity:create_grant(project_id=88c423a2de7d46ff97e231261ac80890, user_id=fbf1e1af2a7643e98d0d9ad60a3d7650, role_id=a2f2dde26304402eb433d8d8cfaca1e7)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:43.887912 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409920c3-11cd-4e74-835b-52ea219d7e4a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:43.888099 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118bd8e-c867-4452-9d05-62ca1d3dce57 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:43.903744 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 85/177] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Oct 30 00:42:43 2022] PUT /identity/v3/projects/88c423a2de7d46ff97e231261ac80890/users/fbf1e1af2a7643e98d0d9ad60a3d7650/roles/a2f2dde26304402eb433d8d8cfaca1e7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:42:43.909415 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118bd8e-c867-4452-9d05-62ca1d3dce57 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:43.927249 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6adc09a-06c4-4d0d-9c81-748c5922cb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:43.928149 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adc09a-06c4-4d0d-9c81-748c5922cb26 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:43.928602 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adc09a-06c4-4d0d-9c81-748c5922cb26 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:43.929069 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adc09a-06c4-4d0d-9c81-748c5922cb26 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:43.929963 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6adc09a-06c4-4d0d-9c81-748c5922cb26 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:43.930451 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6adc09a-06c4-4d0d-9c81-748c5922cb26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:43.932056 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6adc09a-06c4-4d0d-9c81-748c5922cb26 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:43.942156 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 93/178] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:42:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:43.947958 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6adc09a-06c4-4d0d-9c81-748c5922cb26 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:44.015814 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:44.060716 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6adc09a-06c4-4d0d-9c81-748c5922cb26 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:44.098724 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622801df-fe06-4258-9467-086d7c32c3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:44.099828 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622801df-fe06-4258-9467-086d7c32c3ea None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:44.100281 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622801df-fe06-4258-9467-086d7c32c3ea None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:44.100739 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622801df-fe06-4258-9467-086d7c32c3ea None admin] PATH_INFO: `/v3/users/51efaa4403f84bb4944ad9854112e989` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:44.102343 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622801df-fe06-4258-9467-086d7c32c3ea None admin] RBAC: Authorizing `identity:get_user(user_id=51efaa4403f84bb4944ad9854112e989)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:44.104092 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622801df-fe06-4258-9467-086d7c32c3ea None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:44.106161 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 94/179] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:42:43 2022] GET /identity/v3/users/51efaa4403f84bb4944ad9854112e989 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:42:44.112113 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622801df-fe06-4258-9467-086d7c32c3ea None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:44.167552 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118bd8e-c867-4452-9d05-62ca1d3dce57 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:44.170325 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:44.206608 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872caa9d-25a0-421b-8000-dad8e3b48126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:44.207242 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872caa9d-25a0-421b-8000-dad8e3b48126 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:44.207518 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872caa9d-25a0-421b-8000-dad8e3b48126 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:44.207790 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872caa9d-25a0-421b-8000-dad8e3b48126 None admin] PATH_INFO: `/v3/users/51efaa4403f84bb4944ad9854112e989` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:44.209039 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872caa9d-25a0-421b-8000-dad8e3b48126 None admin] RBAC: Authorizing `identity:get_user(user_id=51efaa4403f84bb4944ad9854112e989)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:44.210538 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872caa9d-25a0-421b-8000-dad8e3b48126 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:44.213173 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 86/180] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:42:43 2022] GET /identity/v3/users/51efaa4403f84bb4944ad9854112e989 => generated 283 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:44.217689 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872caa9d-25a0-421b-8000-dad8e3b48126 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:44.248984 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622801df-fe06-4258-9467-086d7c32c3ea None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:44.281977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:44.295605 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2eaa01-fa81-4b86-a9b5-2d4eef4b4c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:44.296478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2eaa01-fa81-4b86-a9b5-2d4eef4b4c9d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:44.296930 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2eaa01-fa81-4b86-a9b5-2d4eef4b4c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:44.297397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2eaa01-fa81-4b86-a9b5-2d4eef4b4c9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:44.400568 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2eaa01-fa81-4b86-a9b5-2d4eef4b4c9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:44.402613 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2eaa01-fa81-4b86-a9b5-2d4eef4b4c9d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:44.413603 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872caa9d-25a0-421b-8000-dad8e3b48126 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:44.480002 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea99d3-51aa-4e46-b636-393fd33c226d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:44.481420 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea99d3-51aa-4e46-b636-393fd33c226d None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:44.482402 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea99d3-51aa-4e46-b636-393fd33c226d None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:44.482853 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea99d3-51aa-4e46-b636-393fd33c226d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:44.543586 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 95/181] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Oct 30 00:42:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 30 00:42:44.550175 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2eaa01-fa81-4b86-a9b5-2d4eef4b4c9d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:44.565850 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:44.585554 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:44.603552 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea99d3-51aa-4e46-b636-393fd33c226d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:44.605307 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea99d3-51aa-4e46-b636-393fd33c226d None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:44.708308 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 87/182] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Oct 30 00:42:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 30 00:42:44.717453 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2eaa01-fa81-4b86-a9b5-2d4eef4b4c9d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:44.718121 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea99d3-51aa-4e46-b636-393fd33c226d None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:44.758873 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ae1b8-702f-4781-8e1f-d50c77aa585f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:44.760479 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ae1b8-702f-4781-8e1f-d50c77aa585f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:44.761127 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ae1b8-702f-4781-8e1f-d50c77aa585f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:44.763329 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ae1b8-702f-4781-8e1f-d50c77aa585f None admin] PATH_INFO: `/v3/projects/88c423a2de7d46ff97e231261ac80890` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:44.766048 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ae1b8-702f-4781-8e1f-d50c77aa585f None admin] RBAC: Authorizing `identity:get_project(project_id=88c423a2de7d46ff97e231261ac80890)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:44.767890 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ae1b8-702f-4781-8e1f-d50c77aa585f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:44.770860 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 96/183] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Oct 30 00:42:44 2022] GET /identity/v3/projects/88c423a2de7d46ff97e231261ac80890 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:44.778094 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ae1b8-702f-4781-8e1f-d50c77aa585f None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:44.848453 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:44.881863 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea99d3-51aa-4e46-b636-393fd33c226d None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:44.918521 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7547e-15db-44e0-893e-747506715e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:44.919240 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7547e-15db-44e0-893e-747506715e92 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:44.919617 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7547e-15db-44e0-893e-747506715e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:44.919987 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7547e-15db-44e0-893e-747506715e92 None admin] PATH_INFO: `/v3/projects/88c423a2de7d46ff97e231261ac80890` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:44.921394 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7547e-15db-44e0-893e-747506715e92 None admin] RBAC: Authorizing `identity:get_project(project_id=88c423a2de7d46ff97e231261ac80890)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:44.922999 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7547e-15db-44e0-893e-747506715e92 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:44.929214 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 88/184] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Oct 30 00:42:44 2022] GET /identity/v3/projects/88c423a2de7d46ff97e231261ac80890 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:44.930685 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7547e-15db-44e0-893e-747506715e92 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:44.957588 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:44.963364 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ae1b8-702f-4781-8e1f-d50c77aa585f None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:45.042372 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7547e-15db-44e0-893e-747506715e92 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:45.073881 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d32630-2ee0-4b56-a2a1-ade23bd13f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:45.074488 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d32630-2ee0-4b56-a2a1-ade23bd13f5f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:45.074766 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d32630-2ee0-4b56-a2a1-ade23bd13f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:45.075076 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d32630-2ee0-4b56-a2a1-ade23bd13f5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:45.075812 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d32630-2ee0-4b56-a2a1-ade23bd13f5f None admin] RBAC: Adding query filter params (role.id=b63857cb2ff04d189523309091368e81, scope.project.id=88c423a2de7d46ff97e231261ac80890, user.id=51efaa4403f84bb4944ad9854112e989) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:45.076118 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d32630-2ee0-4b56-a2a1-ade23bd13f5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:45.077571 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d32630-2ee0-4b56-a2a1-ade23bd13f5f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:45.078796 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942982ae-98d8-43e9-8e7c-d6d165c854c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:45.079811 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942982ae-98d8-43e9-8e7c-d6d165c854c0 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:45.080287 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942982ae-98d8-43e9-8e7c-d6d165c854c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:45.080755 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942982ae-98d8-43e9-8e7c-d6d165c854c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:45.081721 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942982ae-98d8-43e9-8e7c-d6d165c854c0 None admin] RBAC: Adding query filter params (role.id=17d0330d6df84d3091d7ef234dfc4e6b, scope.project.id=88c423a2de7d46ff97e231261ac80890, user.id=51efaa4403f84bb4944ad9854112e989) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:45.082225 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942982ae-98d8-43e9-8e7c-d6d165c854c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:45.083853 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942982ae-98d8-43e9-8e7c-d6d165c854c0 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:45.090576 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 89/185] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Oct 30 00:42:44 2022] GET /identity/v3/role_assignments?user.id=51efaa4403f84bb4944ad9854112e989&scope.project.id=88c423a2de7d46ff97e231261ac80890&role.id=17d0330d6df84d3091d7ef234dfc4e6b => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:42:45.097660 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 97/186] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Oct 30 00:42:44 2022] GET /identity/v3/role_assignments?user.id=51efaa4403f84bb4944ad9854112e989&scope.project.id=88c423a2de7d46ff97e231261ac80890&role.id=b63857cb2ff04d189523309091368e81 => generated 608 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:45.780980 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad07753-0b06-46ed-9fac-443d63ca4920 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:45.781562 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad07753-0b06-46ed-9fac-443d63ca4920 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:45.781562 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad07753-0b06-46ed-9fac-443d63ca4920 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:45.782929 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 90/187] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:45.788859 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27117f-d4db-4046-8b06-75bc63ec8307 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:45.789381 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27117f-d4db-4046-8b06-75bc63ec8307 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:45.789474 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27117f-d4db-4046-8b06-75bc63ec8307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:45.808773 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-5c27117f-d4db-4046-8b06-75bc63ec8307 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:45.810556 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-5c27117f-d4db-4046-8b06-75bc63ec8307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:45.878363 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 98/188] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:42:45.910648 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5304f4-ebe1-4f34-abe6-82194c9a3914 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:45.910954 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5304f4-ebe1-4f34-abe6-82194c9a3914 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:45.911206 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5304f4-ebe1-4f34-abe6-82194c9a3914 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:45.912667 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 91/189] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:45.917748 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850b7c5-671c-4f52-9d59-7baffb732e45 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:45.918033 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850b7c5-671c-4f52-9d59-7baffb732e45 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:45.918304 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850b7c5-671c-4f52-9d59-7baffb732e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:45.936792 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-6850b7c5-671c-4f52-9d59-7baffb732e45 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:45.937909 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6850b7c5-671c-4f52-9d59-7baffb732e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:46.003398 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 99/190] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:42:46.148065 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5304f4-ebe1-4f34-abe6-82194c9a3914 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:46.151212 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:46.253055 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5304f4-ebe1-4f34-abe6-82194c9a3914 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:46.267653 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850b7c5-671c-4f52-9d59-7baffb732e45 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:46.291205 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e4df45-2db6-4134-8b84-0bebc25937cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:46.291834 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4df45-2db6-4134-8b84-0bebc25937cc None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:46.292086 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4df45-2db6-4134-8b84-0bebc25937cc None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:46.292360 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4df45-2db6-4134-8b84-0bebc25937cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:46.292710 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:46.303840 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e4df45-2db6-4134-8b84-0bebc25937cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:42:46.309019 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-03e4df45-2db6-4134-8b84-0bebc25937cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:42:46.309019 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:46.309019 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:42:46.309019 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:42:46.309019 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:42:46.309019 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:42:46.309019 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:42:46.309019 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:42:46.309019 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:42:46.309019 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:42:46.309019 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:42:46.309019 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:42:46.309019 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:42:46.309019 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:42:46.309019 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:42:46.309019 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:42:46.310594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:42:46.310594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:42:46.310594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:42:46.310594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:42:46.310594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:42:46.310594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:42:46.310594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:42:46.310594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:42:46.310594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:42:46.310594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:42:46.310594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:42:46.310594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:42:46.310594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:42:46.310594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:42:46.310594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:42:46.310594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:42:46.311397 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:42:46.311397 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:42:46.311397 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:42:46.311397 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:42:46.311397 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:42:46.311397 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:42:46.311397 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:42:46.311397 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:42:46.311397 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:42:46.311397 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:42:46.311397 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:42:46.311397 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:42:46.311397 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 92/191] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:42:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:42:46.318028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e4df45-2db6-4134-8b84-0bebc25937cc None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:46.376568 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850b7c5-671c-4f52-9d59-7baffb732e45 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:46.384552 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:46.411492 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f820d2c-4c0e-4092-b44c-17d61d87c184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:46.412121 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f820d2c-4c0e-4092-b44c-17d61d87c184 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:46.412385 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f820d2c-4c0e-4092-b44c-17d61d87c184 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:46.412654 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f820d2c-4c0e-4092-b44c-17d61d87c184 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:46.413752 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f820d2c-4c0e-4092-b44c-17d61d87c184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:46.415188 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f820d2c-4c0e-4092-b44c-17d61d87c184 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:46.416741 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 100/192] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:42:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:42:46.422583 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f820d2c-4c0e-4092-b44c-17d61d87c184 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:46.431466 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e4df45-2db6-4134-8b84-0bebc25937cc None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:46.471085 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d233d0-e718-4980-a2a1-62440bbc8aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:46.471705 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d233d0-e718-4980-a2a1-62440bbc8aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:46.471977 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d233d0-e718-4980-a2a1-62440bbc8aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:46.472241 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d233d0-e718-4980-a2a1-62440bbc8aa8 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:46.472916 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d233d0-e718-4980-a2a1-62440bbc8aa8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:46.473235 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d233d0-e718-4980-a2a1-62440bbc8aa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:46.474666 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d233d0-e718-4980-a2a1-62440bbc8aa8 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:46.485578 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 93/193] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Oct 30 00:42:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:42:46.492999 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d233d0-e718-4980-a2a1-62440bbc8aa8 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:46.527923 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:46.538330 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f820d2c-4c0e-4092-b44c-17d61d87c184 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:46.576538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab42ff-893d-4bb0-8284-425158def701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:46.577144 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab42ff-893d-4bb0-8284-425158def701 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:46.577455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab42ff-893d-4bb0-8284-425158def701 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:46.577716 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab42ff-893d-4bb0-8284-425158def701 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:46.578471 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab42ff-893d-4bb0-8284-425158def701 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:46.580044 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab42ff-893d-4bb0-8284-425158def701 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:46.597773 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d233d0-e718-4980-a2a1-62440bbc8aa8 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:46.613216 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 101/194] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Oct 30 00:42:46 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:42:46.613216 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bea4f0-4db6-4611-870f-d28f3c9fafac None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:46.613216 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bea4f0-4db6-4611-870f-d28f3c9fafac None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:46.613216 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bea4f0-4db6-4611-870f-d28f3c9fafac None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:46.613216 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 102/195] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:46.613216 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb598687-3d52-4da7-a90a-5b85313605d9 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:46.613216 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb598687-3d52-4da7-a90a-5b85313605d9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:46.613869 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb598687-3d52-4da7-a90a-5b85313605d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:46.631718 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-bb598687-3d52-4da7-a90a-5b85313605d9 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:46.632944 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-bb598687-3d52-4da7-a90a-5b85313605d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:46.638382 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:46.652078 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea5fa9-cfab-4998-9e45-76e185a5da62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:46.652712 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea5fa9-cfab-4998-9e45-76e185a5da62 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:46.652987 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea5fa9-cfab-4998-9e45-76e185a5da62 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:46.653313 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea5fa9-cfab-4998-9e45-76e185a5da62 None admin] PATH_INFO: `/v3/users/2e5185c1c29544508439023b39a2d7f9` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:46.674952 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea5fa9-cfab-4998-9e45-76e185a5da62 None admin] RBAC: Authorizing `identity:get_user(user_id=2e5185c1c29544508439023b39a2d7f9)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:46.675971 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea5fa9-cfab-4998-9e45-76e185a5da62 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:46.677890 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 94/196] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:42:46 2022] GET /identity/v3/users/2e5185c1c29544508439023b39a2d7f9 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:46.683558 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea5fa9-cfab-4998-9e45-76e185a5da62 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:46.719287 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 103/197] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:42:46.793256 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea5fa9-cfab-4998-9e45-76e185a5da62 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:46.828782 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf58ec3-fac6-482a-822f-e2eda016ba6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:46.829429 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf58ec3-fac6-482a-822f-e2eda016ba6b None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:46.829704 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf58ec3-fac6-482a-822f-e2eda016ba6b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:46.829973 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf58ec3-fac6-482a-822f-e2eda016ba6b None admin] PATH_INFO: `/v3/projects/88c423a2de7d46ff97e231261ac80890` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:46.831136 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf58ec3-fac6-482a-822f-e2eda016ba6b None admin] RBAC: Authorizing `identity:get_project(project_id=88c423a2de7d46ff97e231261ac80890)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:46.832497 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf58ec3-fac6-482a-822f-e2eda016ba6b None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:46.834400 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 95/198] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Oct 30 00:42:46 2022] GET /identity/v3/projects/88c423a2de7d46ff97e231261ac80890 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:42:46.840122 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb598687-3d52-4da7-a90a-5b85313605d9 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:46.930025 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:46.956758 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb598687-3d52-4da7-a90a-5b85313605d9 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:46.991994 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf58ec3-fac6-482a-822f-e2eda016ba6b None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:46.994455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b879b-60c8-4680-8683-28089b99c825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:46.995118 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b879b-60c8-4680-8683-28089b99c825 None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:46.995391 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b879b-60c8-4680-8683-28089b99c825 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:46.995655 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b879b-60c8-4680-8683-28089b99c825 None admin] PATH_INFO: `/v3/projects/88c423a2de7d46ff97e231261ac80890/users/2e5185c1c29544508439023b39a2d7f9/roles/bb8d5dabb95e46ef8120c17cbcca0566` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:46.998540 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b879b-60c8-4680-8683-28089b99c825 None admin] RBAC: Authorizing `identity:create_grant(project_id=88c423a2de7d46ff97e231261ac80890, user_id=2e5185c1c29544508439023b39a2d7f9, role_id=bb8d5dabb95e46ef8120c17cbcca0566)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:47.000203 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b879b-60c8-4680-8683-28089b99c825 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:47.021357 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 104/199] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Oct 30 00:42:46 2022] PUT /identity/v3/projects/88c423a2de7d46ff97e231261ac80890/users/2e5185c1c29544508439023b39a2d7f9/roles/bb8d5dabb95e46ef8120c17cbcca0566 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:42:47.051131 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:47.105956 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf58ec3-fac6-482a-822f-e2eda016ba6b None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:47.144619 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c289151-d8a5-4949-a642-1c8e512fe201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:47.145279 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c289151-d8a5-4949-a642-1c8e512fe201 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:47.145554 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c289151-d8a5-4949-a642-1c8e512fe201 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:47.145817 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c289151-d8a5-4949-a642-1c8e512fe201 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:47.158480 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c289151-d8a5-4949-a642-1c8e512fe201 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:42:47.163485 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-9c289151-d8a5-4949-a642-1c8e512fe201 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:42:47.163485 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:47.163485 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:42:47.163485 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:42:47.163485 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:42:47.163485 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:42:47.163485 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:42:47.163485 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:42:47.163485 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:42:47.163485 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:42:47.163485 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:42:47.163485 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:42:47.163485 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:42:47.163485 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:42:47.163485 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:42:47.163485 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:42:47.164436 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:42:47.164436 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:42:47.164436 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:42:47.164436 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:42:47.164436 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:42:47.164436 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:42:47.164436 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:42:47.164436 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:42:47.164436 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:42:47.164436 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:42:47.164436 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:42:47.164436 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:42:47.164436 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:42:47.164436 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:42:47.164436 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:42:47.164436 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:42:47.165271 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:42:47.165271 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:42:47.165271 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:42:47.165271 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:42:47.165271 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:42:47.165271 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:42:47.165271 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:42:47.165271 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:42:47.165271 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:42:47.165271 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:42:47.165271 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:42:47.165271 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:42:47.169489 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 96/200] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:42:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:42:47.171651 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b879b-60c8-4680-8683-28089b99c825 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:47.290314 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b879b-60c8-4680-8683-28089b99c825 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:47.327847 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7629a-513a-46cf-a260-507c30a905cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:47.328359 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7629a-513a-46cf-a260-507c30a905cf None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:47.328633 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7629a-513a-46cf-a260-507c30a905cf None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:47.328899 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7629a-513a-46cf-a260-507c30a905cf None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:47.329578 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7629a-513a-46cf-a260-507c30a905cf None admin] RBAC: Adding query filter params (name=member) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:47.329881 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7629a-513a-46cf-a260-507c30a905cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:47.331245 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7629a-513a-46cf-a260-507c30a905cf None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:47.333449 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:47.342038 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 105/201] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Oct 30 00:42:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:47.347108 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c289151-d8a5-4949-a642-1c8e512fe201 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:47.452387 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c289151-d8a5-4949-a642-1c8e512fe201 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:47.463870 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:47.487901 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc9a7a-7c50-4a76-9ac1-a33ef4734bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:47.488647 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc9a7a-7c50-4a76-9ac1-a33ef4734bff None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:47.488925 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc9a7a-7c50-4a76-9ac1-a33ef4734bff None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:47.489282 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc9a7a-7c50-4a76-9ac1-a33ef4734bff None admin] PATH_INFO: `/v3/users/fbf1e1af2a7643e98d0d9ad60a3d7650` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:47.490420 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc9a7a-7c50-4a76-9ac1-a33ef4734bff None admin] RBAC: Authorizing `identity:get_user(user_id=fbf1e1af2a7643e98d0d9ad60a3d7650)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:47.491881 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc9a7a-7c50-4a76-9ac1-a33ef4734bff None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:47.493772 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 97/202] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:42:47 2022] GET /identity/v3/users/fbf1e1af2a7643e98d0d9ad60a3d7650 => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:47.500002 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7629a-513a-46cf-a260-507c30a905cf None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:47.613987 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7629a-513a-46cf-a260-507c30a905cf None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:47.651380 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3b433-d96f-4b99-8095-6460b7ed61f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:47.652336 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3b433-d96f-4b99-8095-6460b7ed61f3 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:47.652812 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3b433-d96f-4b99-8095-6460b7ed61f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:47.653880 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3b433-d96f-4b99-8095-6460b7ed61f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:47.728272 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:47.734169 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3b433-d96f-4b99-8095-6460b7ed61f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:47.735672 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3b433-d96f-4b99-8095-6460b7ed61f3 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:47.841739 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 106/203] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Oct 30 00:42:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:42:47.848096 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc9a7a-7c50-4a76-9ac1-a33ef4734bff None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:47.951427 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc9a7a-7c50-4a76-9ac1-a33ef4734bff None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:47.988123 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd2f5d-33f7-47cc-b9e5-c7fed07cb5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:47.989134 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd2f5d-33f7-47cc-b9e5-c7fed07cb5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:47.989656 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd2f5d-33f7-47cc-b9e5-c7fed07cb5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:47.990161 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd2f5d-33f7-47cc-b9e5-c7fed07cb5e7 None admin] PATH_INFO: `/v3/projects/88c423a2de7d46ff97e231261ac80890` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:47.991655 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd2f5d-33f7-47cc-b9e5-c7fed07cb5e7 None admin] RBAC: Authorizing `identity:get_project(project_id=88c423a2de7d46ff97e231261ac80890)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:47.993512 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd2f5d-33f7-47cc-b9e5-c7fed07cb5e7 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:47.995930 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 98/204] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Oct 30 00:42:47 2022] GET /identity/v3/projects/88c423a2de7d46ff97e231261ac80890 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:48.002790 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3b433-d96f-4b99-8095-6460b7ed61f3 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:48.108718 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:48.112583 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3b433-d96f-4b99-8095-6460b7ed61f3 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:48.147555 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4086fb7-2092-4afd-8623-4ef20f8d1823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:48.148153 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4086fb7-2092-4afd-8623-4ef20f8d1823 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:48.148428 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4086fb7-2092-4afd-8623-4ef20f8d1823 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:48.148963 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4086fb7-2092-4afd-8623-4ef20f8d1823 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:48.149721 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4086fb7-2092-4afd-8623-4ef20f8d1823 None admin] RBAC: Adding query filter params (role.id=a2f2dde26304402eb433d8d8cfaca1e7, scope.project.id=88c423a2de7d46ff97e231261ac80890, user.id=fbf1e1af2a7643e98d0d9ad60a3d7650) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:48.150021 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4086fb7-2092-4afd-8623-4ef20f8d1823 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:48.151448 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4086fb7-2092-4afd-8623-4ef20f8d1823 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:48.158301 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 107/205] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Oct 30 00:42:48 2022] GET /identity/v3/role_assignments?user.id=fbf1e1af2a7643e98d0d9ad60a3d7650&scope.project.id=88c423a2de7d46ff97e231261ac80890&role.id=a2f2dde26304402eb433d8d8cfaca1e7 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:49.020623 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4755b24-e850-4967-a9dc-294fdc9f55a9 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:49.021157 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4755b24-e850-4967-a9dc-294fdc9f55a9 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:49.021157 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4755b24-e850-4967-a9dc-294fdc9f55a9 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:49.022692 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 99/206] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:49.027915 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1802621-e681-466c-87f1-97230221646e None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:49.028813 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1802621-e681-466c-87f1-97230221646e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:49.028990 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1802621-e681-466c-87f1-97230221646e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:49.038471 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc1da5-a138-4eb1-8a7b-f2c48bf05352 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:49.038748 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc1da5-a138-4eb1-8a7b-f2c48bf05352 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:49.039019 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc1da5-a138-4eb1-8a7b-f2c48bf05352 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:49.040397 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 100/207] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:42:49.045890 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4740d9e-54b5-4300-8fa6-7937f5ee44f2 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:49.046170 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4740d9e-54b5-4300-8fa6-7937f5ee44f2 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:49.046440 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4740d9e-54b5-4300-8fa6-7937f5ee44f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:49.047761 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-e1802621-e681-466c-87f1-97230221646e None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:49.048941 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e1802621-e681-466c-87f1-97230221646e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:49.063891 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-d4740d9e-54b5-4300-8fa6-7937f5ee44f2 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:49.065056 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-d4740d9e-54b5-4300-8fa6-7937f5ee44f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:49.111953 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:49.117750 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 108/208] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:42:49.139993 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 101/209] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:42:49.277591 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8015c56-3ca3-4bda-aee0-06a3907ef6f2 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:49.277881 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8015c56-3ca3-4bda-aee0-06a3907ef6f2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:49.278087 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8015c56-3ca3-4bda-aee0-06a3907ef6f2 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:49.279432 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 109/210] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:49.284646 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e1320-7b6b-4a89-97e8-b4b51ad1f5a1 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:49.284930 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e1320-7b6b-4a89-97e8-b4b51ad1f5a1 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:49.285223 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e1320-7b6b-4a89-97e8-b4b51ad1f5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:49.303882 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-5d8e1320-7b6b-4a89-97e8-b4b51ad1f5a1 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:49.305075 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-5d8e1320-7b6b-4a89-97e8-b4b51ad1f5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:49.372864 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 102/211] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:42:49.393320 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8015c56-3ca3-4bda-aee0-06a3907ef6f2 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:49.410211 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e1320-7b6b-4a89-97e8-b4b51ad1f5a1 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:49.490590 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:49.500971 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8015c56-3ca3-4bda-aee0-06a3907ef6f2 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:49.516513 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e1320-7b6b-4a89-97e8-b4b51ad1f5a1 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:49.525006 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:49.537459 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98bc24-ca25-4096-90a6-23ee4c0da376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:49.538015 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98bc24-ca25-4096-90a6-23ee4c0da376 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:49.538285 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98bc24-ca25-4096-90a6-23ee4c0da376 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:49.538550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98bc24-ca25-4096-90a6-23ee4c0da376 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:49.539636 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98bc24-ca25-4096-90a6-23ee4c0da376 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:49.541064 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98bc24-ca25-4096-90a6-23ee4c0da376 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:49.542917 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 110/212] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:42:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:49.548168 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98bc24-ca25-4096-90a6-23ee4c0da376 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:49.556621 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef047432-dac0-4649-ab6b-2d50d604dba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:49.557272 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef047432-dac0-4649-ab6b-2d50d604dba3 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:49.557558 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef047432-dac0-4649-ab6b-2d50d604dba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:49.557809 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef047432-dac0-4649-ab6b-2d50d604dba3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:49.568573 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef047432-dac0-4649-ab6b-2d50d604dba3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:42:49.573358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-ef047432-dac0-4649-ab6b-2d50d604dba3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:42:49.573358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:49.573358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:42:49.573358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:42:49.573358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:42:49.573358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:42:49.573358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:42:49.573358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:42:49.573358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:42:49.573358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:42:49.573358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:42:49.573358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:42:49.573358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:42:49.573358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:42:49.573358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:42:49.573358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:42:49.574236 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:42:49.574236 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:42:49.574236 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:42:49.574236 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:42:49.574236 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:42:49.574236 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:42:49.574236 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:42:49.574236 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:42:49.574236 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:42:49.574236 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:42:49.574236 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:42:49.574236 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:42:49.574236 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:42:49.574236 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:42:49.574236 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:42:49.574236 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:42:49.575634 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:42:49.575634 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:42:49.575634 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:42:49.575634 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:42:49.575634 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:42:49.575634 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:42:49.575634 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:42:49.575634 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:42:49.575634 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:42:49.575634 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:42:49.575634 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:42:49.575634 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:42:49.575634 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 103/213] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:42:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:42:49.582581 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef047432-dac0-4649-ab6b-2d50d604dba3 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:49.656064 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98bc24-ca25-4096-90a6-23ee4c0da376 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:49.687251 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef047432-dac0-4649-ab6b-2d50d604dba3 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:49.691272 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4dfd8-63f5-4c02-b2ba-3c5c8b9d34f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:49.691863 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4dfd8-63f5-4c02-b2ba-3c5c8b9d34f4 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:49.692136 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4dfd8-63f5-4c02-b2ba-3c5c8b9d34f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:49.692403 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4dfd8-63f5-4c02-b2ba-3c5c8b9d34f4 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:49.693051 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4dfd8-63f5-4c02-b2ba-3c5c8b9d34f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:49.694518 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4dfd8-63f5-4c02-b2ba-3c5c8b9d34f4 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:49.714832 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 111/214] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Oct 30 00:42:49 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:42:49.716172 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4dfd8-63f5-4c02-b2ba-3c5c8b9d34f4 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:49.733522 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428aeb7-ed85-427b-9964-61e8399d4605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:49.734315 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428aeb7-ed85-427b-9964-61e8399d4605 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:49.734597 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428aeb7-ed85-427b-9964-61e8399d4605 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:49.734869 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428aeb7-ed85-427b-9964-61e8399d4605 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:49.735601 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428aeb7-ed85-427b-9964-61e8399d4605 None admin] RBAC: Adding query filter params (name=member) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:49.735879 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428aeb7-ed85-427b-9964-61e8399d4605 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:49.736332 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:49.737449 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428aeb7-ed85-427b-9964-61e8399d4605 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:49.747821 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 104/215] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Oct 30 00:42:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:42:49.753883 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428aeb7-ed85-427b-9964-61e8399d4605 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:49.789801 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:49.842710 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4dfd8-63f5-4c02-b2ba-3c5c8b9d34f4 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:49.870185 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428aeb7-ed85-427b-9964-61e8399d4605 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:49.882520 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5015c-274a-4c30-869e-585d14ec63fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:49.883155 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5015c-274a-4c30-869e-585d14ec63fa None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:49.883431 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5015c-274a-4c30-869e-585d14ec63fa None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:49.883698 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5015c-274a-4c30-869e-585d14ec63fa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:49.896643 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5015c-274a-4c30-869e-585d14ec63fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:42:49.902277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-04d5015c-274a-4c30-869e-585d14ec63fa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:42:49.902277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:49.902277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:42:49.902277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:42:49.902277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:42:49.902277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:42:49.902277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:42:49.902277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:42:49.902277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:42:49.902277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:42:49.902277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:42:49.902277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:42:49.902277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:42:49.902277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:42:49.902277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:42:49.902277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:42:49.903728 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:42:49.903728 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:42:49.903728 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:42:49.903728 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:42:49.903728 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:42:49.903728 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:42:49.903728 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:42:49.903728 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:42:49.903728 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:42:49.903728 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:42:49.903728 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:42:49.903728 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:42:49.903728 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:42:49.903728 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:42:49.903728 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:42:49.903728 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:42:49.904529 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:42:49.904529 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:42:49.904529 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:42:49.904529 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:42:49.904529 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:42:49.904529 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:42:49.904529 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:42:49.904529 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:42:49.904529 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:42:49.904529 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:42:49.904529 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:42:49.904529 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:42:49.904529 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 112/216] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:42:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:42:49.909987 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5015c-274a-4c30-869e-585d14ec63fa None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:49.912036 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f932f0-2387-493c-94df-e072b9687c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:49.912675 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f932f0-2387-493c-94df-e072b9687c03 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:49.912949 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f932f0-2387-493c-94df-e072b9687c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:49.913255 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f932f0-2387-493c-94df-e072b9687c03 None admin] PATH_INFO: `/v3/users/d3028f181b6e4bd9abc1ce3432603f85` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:49.929521 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f932f0-2387-493c-94df-e072b9687c03 None admin] RBAC: Authorizing `identity:get_user(user_id=d3028f181b6e4bd9abc1ce3432603f85)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:49.931814 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f932f0-2387-493c-94df-e072b9687c03 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:49.933691 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 105/217] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:42:49 2022] GET /identity/v3/users/d3028f181b6e4bd9abc1ce3432603f85 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:42:49.939523 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f932f0-2387-493c-94df-e072b9687c03 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:50.003034 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:50.037242 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5015c-274a-4c30-869e-585d14ec63fa None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:50.054399 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:50.062039 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f932f0-2387-493c-94df-e072b9687c03 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:50.076253 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0095379-38b7-4fed-b6ba-addbc3270b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:50.076985 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0095379-38b7-4fed-b6ba-addbc3270b32 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:50.079176 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0095379-38b7-4fed-b6ba-addbc3270b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:50.079445 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0095379-38b7-4fed-b6ba-addbc3270b32 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:50.080185 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0095379-38b7-4fed-b6ba-addbc3270b32 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:50.080492 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0095379-38b7-4fed-b6ba-addbc3270b32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:50.081907 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0095379-38b7-4fed-b6ba-addbc3270b32 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:50.091592 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 113/218] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Oct 30 00:42:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:42:50.097141 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0095379-38b7-4fed-b6ba-addbc3270b32 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:50.105470 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96faef-01a9-46c6-bc43-f9a8b9709c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:50.106065 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96faef-01a9-46c6-bc43-f9a8b9709c8e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:50.106398 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96faef-01a9-46c6-bc43-f9a8b9709c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:50.106666 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96faef-01a9-46c6-bc43-f9a8b9709c8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:50.107385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96faef-01a9-46c6-bc43-f9a8b9709c8e None admin] RBAC: Adding query filter params (role.id=a2f2dde26304402eb433d8d8cfaca1e7, user.id=d3028f181b6e4bd9abc1ce3432603f85, scope.system=all) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:50.107682 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96faef-01a9-46c6-bc43-f9a8b9709c8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:50.109115 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96faef-01a9-46c6-bc43-f9a8b9709c8e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:50.114737 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 106/219] 10.222.0.40 () {56 vars in 1308 bytes} [Sun Oct 30 00:42:49 2022] GET /identity/v3/role_assignments?user.id=d3028f181b6e4bd9abc1ce3432603f85&scope.system=all&role.id=a2f2dde26304402eb433d8d8cfaca1e7 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:42:50.220014 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0095379-38b7-4fed-b6ba-addbc3270b32 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:50.261372 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f06996-8a99-45e7-919f-29ed9a948937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:50.262308 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f06996-8a99-45e7-919f-29ed9a948937 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:50.263449 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f06996-8a99-45e7-919f-29ed9a948937 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:50.263885 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f06996-8a99-45e7-919f-29ed9a948937 None admin] PATH_INFO: `/v3/users/2e5185c1c29544508439023b39a2d7f9` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:50.265502 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f06996-8a99-45e7-919f-29ed9a948937 None admin] RBAC: Authorizing `identity:get_user(user_id=2e5185c1c29544508439023b39a2d7f9)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:50.267247 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f06996-8a99-45e7-919f-29ed9a948937 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:50.269499 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 114/220] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:42:50 2022] GET /identity/v3/users/2e5185c1c29544508439023b39a2d7f9 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:50.277301 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96faef-01a9-46c6-bc43-f9a8b9709c8e None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:50.381372 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96faef-01a9-46c6-bc43-f9a8b9709c8e None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:50.417590 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15a0a6-bb9b-46d1-8a60-c20d432aae03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:50.418193 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15a0a6-bb9b-46d1-8a60-c20d432aae03 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:50.418466 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15a0a6-bb9b-46d1-8a60-c20d432aae03 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:50.418762 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15a0a6-bb9b-46d1-8a60-c20d432aae03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:50.438281 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:50.491731 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15a0a6-bb9b-46d1-8a60-c20d432aae03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:50.493207 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15a0a6-bb9b-46d1-8a60-c20d432aae03 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:50.593334 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 107/221] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Oct 30 00:42:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:42:50.598599 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f06996-8a99-45e7-919f-29ed9a948937 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:50.613951 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:50.718742 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f06996-8a99-45e7-919f-29ed9a948937 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:50.754331 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a5f69-a45a-44ce-90d7-a6822c1dd0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:50.754954 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a5f69-a45a-44ce-90d7-a6822c1dd0cf None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:50.755232 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a5f69-a45a-44ce-90d7-a6822c1dd0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:50.755505 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a5f69-a45a-44ce-90d7-a6822c1dd0cf None admin] PATH_INFO: `/v3/projects/88c423a2de7d46ff97e231261ac80890` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:50.756633 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a5f69-a45a-44ce-90d7-a6822c1dd0cf None admin] RBAC: Authorizing `identity:get_project(project_id=88c423a2de7d46ff97e231261ac80890)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:50.758153 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a5f69-a45a-44ce-90d7-a6822c1dd0cf None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:50.759895 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 115/222] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Oct 30 00:42:50 2022] GET /identity/v3/projects/88c423a2de7d46ff97e231261ac80890 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:50.766579 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15a0a6-bb9b-46d1-8a60-c20d432aae03 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:50.820053 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:50.874087 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15a0a6-bb9b-46d1-8a60-c20d432aae03 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:50.909313 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5966704-d138-4f83-a240-628b9cb03ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:50.909908 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5966704-d138-4f83-a240-628b9cb03ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:50.910181 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5966704-d138-4f83-a240-628b9cb03ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:50.910450 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5966704-d138-4f83-a240-628b9cb03ab7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:50.911159 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5966704-d138-4f83-a240-628b9cb03ab7 None admin] RBAC: Adding query filter params (role.id=bb8d5dabb95e46ef8120c17cbcca0566, scope.project.id=88c423a2de7d46ff97e231261ac80890, user.id=2e5185c1c29544508439023b39a2d7f9) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:50.911461 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5966704-d138-4f83-a240-628b9cb03ab7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:50.912883 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5966704-d138-4f83-a240-628b9cb03ab7 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:50.918945 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 108/223] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Oct 30 00:42:50 2022] GET /identity/v3/role_assignments?user.id=2e5185c1c29544508439023b39a2d7f9&scope.project.id=88c423a2de7d46ff97e231261ac80890&role.id=bb8d5dabb95e46ef8120c17cbcca0566 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:52.061314 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f02431-8fd6-4282-acaa-29478f295948 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:52.061821 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f02431-8fd6-4282-acaa-29478f295948 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:52.061925 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f02431-8fd6-4282-acaa-29478f295948 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:52.063355 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 116/224] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:52.068267 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6871867-b836-42f3-9925-6d8c249cc75f None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:52.068637 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6871867-b836-42f3-9925-6d8c249cc75f None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:52.068807 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6871867-b836-42f3-9925-6d8c249cc75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:52.086516 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-a6871867-b836-42f3-9925-6d8c249cc75f None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:52.087667 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a6871867-b836-42f3-9925-6d8c249cc75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:52.145083 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2549a-722c-4a35-90ac-29b37dd4ec7c None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:52.145553 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2549a-722c-4a35-90ac-29b37dd4ec7c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:52.145897 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2549a-722c-4a35-90ac-29b37dd4ec7c None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:52.147310 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 117/225] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:42:52.152521 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a3fcb-066f-44a5-baec-2d3cc2af1604 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:52.152804 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a3fcb-066f-44a5-baec-2d3cc2af1604 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:52.153078 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a3fcb-066f-44a5-baec-2d3cc2af1604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:52.154310 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 109/226] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:42:52.171800 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-2f6a3fcb-066f-44a5-baec-2d3cc2af1604 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:52.173218 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2f6a3fcb-066f-44a5-baec-2d3cc2af1604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:52.245055 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 118/227] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:42:52.308086 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb5e27-8c29-42a6-8454-601515969251 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:52.308369 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb5e27-8c29-42a6-8454-601515969251 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:52.308634 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb5e27-8c29-42a6-8454-601515969251 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:52.310696 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 110/228] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:52.315701 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ed850-a419-4080-8048-455d6abf7fa0 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:52.315936 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ed850-a419-4080-8048-455d6abf7fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:52.316212 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ed850-a419-4080-8048-455d6abf7fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:52.323428 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:52.334707 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-b30ed850-a419-4080-8048-455d6abf7fa0 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:52.335886 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b30ed850-a419-4080-8048-455d6abf7fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:52.404121 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 119/229] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:42:52.420559 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb5e27-8c29-42a6-8454-601515969251 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:52.469323 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:52.516463 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ed850-a419-4080-8048-455d6abf7fa0 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:52.526200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb5e27-8c29-42a6-8454-601515969251 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:52.571853 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3eb60c-ad10-4bf6-ba0a-6ca71d9f39c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:52.572821 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3eb60c-ad10-4bf6-ba0a-6ca71d9f39c2 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:52.573106 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3eb60c-ad10-4bf6-ba0a-6ca71d9f39c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:52.573404 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3eb60c-ad10-4bf6-ba0a-6ca71d9f39c2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:52.584203 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3eb60c-ad10-4bf6-ba0a-6ca71d9f39c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:42:52.588946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-1c3eb60c-ad10-4bf6-ba0a-6ca71d9f39c2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:42:52.588946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:52.588946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:42:52.588946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:42:52.588946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:42:52.588946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:42:52.588946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:42:52.588946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:42:52.588946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:42:52.588946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:42:52.588946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:42:52.588946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:42:52.588946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:42:52.588946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:42:52.588946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:42:52.588946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:42:52.589975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:42:52.589975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:42:52.589975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:42:52.589975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:42:52.589975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:42:52.589975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:42:52.589975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:42:52.589975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:42:52.589975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:42:52.589975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:42:52.589975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:42:52.589975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:42:52.589975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:42:52.589975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:42:52.589975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:42:52.589975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:42:52.591331 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:42:52.591331 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:42:52.591331 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:42:52.591331 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:42:52.591331 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:42:52.591331 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:42:52.591331 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:42:52.591331 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:42:52.591331 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:42:52.591331 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:42:52.591331 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:42:52.591331 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:42:52.591331 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 111/230] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:42:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:42:52.596130 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3eb60c-ad10-4bf6-ba0a-6ca71d9f39c2 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:52.623978 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ed850-a419-4080-8048-455d6abf7fa0 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:52.660509 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda1a4d-0eb4-4e56-b0e9-088a4b086e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:52.661163 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda1a4d-0eb4-4e56-b0e9-088a4b086e56 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:52.663134 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda1a4d-0eb4-4e56-b0e9-088a4b086e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:52.663419 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda1a4d-0eb4-4e56-b0e9-088a4b086e56 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:52.664515 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda1a4d-0eb4-4e56-b0e9-088a4b086e56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:52.669547 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda1a4d-0eb4-4e56-b0e9-088a4b086e56 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:52.669547 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 120/231] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:42:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:42:52.673505 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda1a4d-0eb4-4e56-b0e9-088a4b086e56 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:52.676214 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:52.711122 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3eb60c-ad10-4bf6-ba0a-6ca71d9f39c2 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:52.713402 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:52.744861 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e76af-676f-4d13-aa93-9b0dc5da2348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:52.745484 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e76af-676f-4d13-aa93-9b0dc5da2348 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:52.745759 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e76af-676f-4d13-aa93-9b0dc5da2348 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:52.746031 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e76af-676f-4d13-aa93-9b0dc5da2348 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:52.746676 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e76af-676f-4d13-aa93-9b0dc5da2348 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:52.746995 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e76af-676f-4d13-aa93-9b0dc5da2348 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:52.748374 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e76af-676f-4d13-aa93-9b0dc5da2348 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:52.756261 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 112/232] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Oct 30 00:42:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:42:52.756261 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e76af-676f-4d13-aa93-9b0dc5da2348 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:52.771876 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda1a4d-0eb4-4e56-b0e9-088a4b086e56 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:52.807350 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98dc4f-1281-4db9-a29e-a22f1470be6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:52.807941 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98dc4f-1281-4db9-a29e-a22f1470be6f None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:52.808215 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98dc4f-1281-4db9-a29e-a22f1470be6f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:52.808488 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98dc4f-1281-4db9-a29e-a22f1470be6f None admin] PATH_INFO: `/v3/groups` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:52.809102 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98dc4f-1281-4db9-a29e-a22f1470be6f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:52.810602 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98dc4f-1281-4db9-a29e-a22f1470be6f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:52.825785 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 121/233] 10.222.0.40 () {60 vars in 1134 bytes} [Sun Oct 30 00:42:52 2022] POST /identity/v3/groups => generated 229 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:42:52.826421 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98dc4f-1281-4db9-a29e-a22f1470be6f None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:52.862109 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e76af-676f-4d13-aa93-9b0dc5da2348 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:52.895223 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:52.906918 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fef55f-b326-434f-86c0-ccfe95dcb900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:52.908155 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fef55f-b326-434f-86c0-ccfe95dcb900 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:52.908155 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fef55f-b326-434f-86c0-ccfe95dcb900 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:52.908155 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fef55f-b326-434f-86c0-ccfe95dcb900 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:52.921137 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fef55f-b326-434f-86c0-ccfe95dcb900 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:42:52.926734 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-67fef55f-b326-434f-86c0-ccfe95dcb900 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:42:52.926734 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:52.926734 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:42:52.926734 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:42:52.926734 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:42:52.926734 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:42:52.926734 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:42:52.926734 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:42:52.926734 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:42:52.926734 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:42:52.926734 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:42:52.926734 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:42:52.926734 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:42:52.926734 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:42:52.926734 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:42:52.926734 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:42:52.927670 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:42:52.927670 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:42:52.927670 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:42:52.927670 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:42:52.927670 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:42:52.927670 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:42:52.927670 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:42:52.927670 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:42:52.927670 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:42:52.927670 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:42:52.927670 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:42:52.927670 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:42:52.927670 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:42:52.927670 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:42:52.927670 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:42:52.927670 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:42:52.928442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:42:52.928442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:42:52.928442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:42:52.928442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:42:52.928442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:42:52.928442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:42:52.928442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:42:52.928442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:42:52.928442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:42:52.928442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:42:52.928442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:42:52.928442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:42:52.928442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 113/234] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:42:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:42:52.934493 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fef55f-b326-434f-86c0-ccfe95dcb900 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:52.943100 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98dc4f-1281-4db9-a29e-a22f1470be6f None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:52.968295 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:52.984677 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ba7eb-41ac-49ab-ad19-2be0d55010aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:52.985359 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ba7eb-41ac-49ab-ad19-2be0d55010aa None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:52.985977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ba7eb-41ac-49ab-ad19-2be0d55010aa None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:52.986538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ba7eb-41ac-49ab-ad19-2be0d55010aa None admin] PATH_INFO: `/v3/users/8eceb664a6f74b18b5c0c16fabab9bc8` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:53.004222 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ba7eb-41ac-49ab-ad19-2be0d55010aa None admin] RBAC: Authorizing `identity:get_user(user_id=8eceb664a6f74b18b5c0c16fabab9bc8)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:53.006033 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ba7eb-41ac-49ab-ad19-2be0d55010aa None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:53.007094 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 122/235] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:42:52 2022] GET /identity/v3/users/8eceb664a6f74b18b5c0c16fabab9bc8 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:53.013314 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ba7eb-41ac-49ab-ad19-2be0d55010aa None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:53.054339 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fef55f-b326-434f-86c0-ccfe95dcb900 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:53.089861 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9add02-9cf2-4cfb-9b91-fa75204c6071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:53.091261 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9add02-9cf2-4cfb-9b91-fa75204c6071 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:53.091731 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9add02-9cf2-4cfb-9b91-fa75204c6071 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:53.092204 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9add02-9cf2-4cfb-9b91-fa75204c6071 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:53.092863 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9add02-9cf2-4cfb-9b91-fa75204c6071 None admin] RBAC: Adding query filter params (name=member) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:53.093159 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9add02-9cf2-4cfb-9b91-fa75204c6071 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:53.094550 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9add02-9cf2-4cfb-9b91-fa75204c6071 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:53.109074 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 114/236] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Oct 30 00:42:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:53.110805 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9add02-9cf2-4cfb-9b91-fa75204c6071 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:53.117565 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ba7eb-41ac-49ab-ad19-2be0d55010aa None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:53.139983 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:53.154448 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b33ee0-5650-49dd-92a0-b84285f41858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:53.155050 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b33ee0-5650-49dd-92a0-b84285f41858 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:53.155328 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b33ee0-5650-49dd-92a0-b84285f41858 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:53.155603 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b33ee0-5650-49dd-92a0-b84285f41858 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:53.156331 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b33ee0-5650-49dd-92a0-b84285f41858 None admin] RBAC: Adding query filter params (role.id=bb8d5dabb95e46ef8120c17cbcca0566, user.id=8eceb664a6f74b18b5c0c16fabab9bc8, scope.system=all) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:53.156637 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b33ee0-5650-49dd-92a0-b84285f41858 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:53.158106 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b33ee0-5650-49dd-92a0-b84285f41858 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:53.163827 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 123/237] 10.222.0.40 () {56 vars in 1308 bytes} [Sun Oct 30 00:42:53 2022] GET /identity/v3/role_assignments?user.id=8eceb664a6f74b18b5c0c16fabab9bc8&scope.system=all&role.id=bb8d5dabb95e46ef8120c17cbcca0566 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:42:53.211060 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:53.225537 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9add02-9cf2-4cfb-9b91-fa75204c6071 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:53.265108 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388cf05-4245-420b-aa57-c31b4d48847e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:53.265854 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388cf05-4245-420b-aa57-c31b4d48847e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:53.266195 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388cf05-4245-420b-aa57-c31b4d48847e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:53.266529 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388cf05-4245-420b-aa57-c31b4d48847e None admin] PATH_INFO: `/v3/users/d3028f181b6e4bd9abc1ce3432603f85` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:53.267753 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388cf05-4245-420b-aa57-c31b4d48847e None admin] RBAC: Authorizing `identity:get_user(user_id=d3028f181b6e4bd9abc1ce3432603f85)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:53.269326 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388cf05-4245-420b-aa57-c31b4d48847e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:53.275848 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 115/238] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:42:53 2022] GET /identity/v3/users/d3028f181b6e4bd9abc1ce3432603f85 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:53.277492 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b33ee0-5650-49dd-92a0-b84285f41858 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:53.386705 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b33ee0-5650-49dd-92a0-b84285f41858 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:53.423183 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a9df7-a4cb-415a-81b2-24f4139e7da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:53.424061 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a9df7-a4cb-415a-81b2-24f4139e7da8 None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:53.424481 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a9df7-a4cb-415a-81b2-24f4139e7da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:53.424897 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a9df7-a4cb-415a-81b2-24f4139e7da8 None admin] PATH_INFO: `/v3/system/users/d3028f181b6e4bd9abc1ce3432603f85/roles/a2f2dde26304402eb433d8d8cfaca1e7` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:53.426582 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a9df7-a4cb-415a-81b2-24f4139e7da8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d3028f181b6e4bd9abc1ce3432603f85, role_id=a2f2dde26304402eb433d8d8cfaca1e7)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:53.428251 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a9df7-a4cb-415a-81b2-24f4139e7da8 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:53.445290 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 124/239] 10.222.0.40 () {58 vars in 1334 bytes} [Sun Oct 30 00:42:53 2022] PUT /identity/v3/system/users/d3028f181b6e4bd9abc1ce3432603f85/roles/a2f2dde26304402eb433d8d8cfaca1e7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:42:55.009070 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4f122-2ef9-4eab-99c5-1a7339e07242 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:55.009578 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4f122-2ef9-4eab-99c5-1a7339e07242 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:55.009652 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4f122-2ef9-4eab-99c5-1a7339e07242 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:55.011104 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 116/240] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:55.016073 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e368052-78d8-4566-aff5-1946cc5845bf None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:55.016463 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e368052-78d8-4566-aff5-1946cc5845bf None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:55.016617 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e368052-78d8-4566-aff5-1946cc5845bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:55.035480 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-3e368052-78d8-4566-aff5-1946cc5845bf None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:55.036656 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3e368052-78d8-4566-aff5-1946cc5845bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:55.081419 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:55.105873 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 125/241] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:42:55.309653 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f157e-83ec-4fb6-8239-6ff03f58d5ff None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:55.309985 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f157e-83ec-4fb6-8239-6ff03f58d5ff None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:55.310179 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f157e-83ec-4fb6-8239-6ff03f58d5ff None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:55.311595 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 117/242] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:55.316624 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f3895-f6f2-4131-afa9-4d5c79667259 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:55.316912 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f3895-f6f2-4131-afa9-4d5c79667259 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:55.317203 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f3895-f6f2-4131-afa9-4d5c79667259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:55.335742 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-364f3895-f6f2-4131-afa9-4d5c79667259 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:55.336910 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-364f3895-f6f2-4131-afa9-4d5c79667259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:55.370113 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f157e-83ec-4fb6-8239-6ff03f58d5ff None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:55.407282 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 126/243] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:42:55.477707 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f157e-83ec-4fb6-8239-6ff03f58d5ff None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:55.511226 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d4536-349c-479f-bfe2-3b439df94d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:55.511833 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d4536-349c-479f-bfe2-3b439df94d98 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:55.512104 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d4536-349c-479f-bfe2-3b439df94d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:55.512925 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d4536-349c-479f-bfe2-3b439df94d98 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:55.514014 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d4536-349c-479f-bfe2-3b439df94d98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:55.515431 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d4536-349c-479f-bfe2-3b439df94d98 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:55.517126 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 118/244] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:42:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:42:55.522426 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f3895-f6f2-4131-afa9-4d5c79667259 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:55.565299 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7f4e3-fcae-43d4-9edb-d4f37295964c None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:55.565619 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7f4e3-fcae-43d4-9edb-d4f37295964c None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:55.565845 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7f4e3-fcae-43d4-9edb-d4f37295964c None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:55.568063 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 119/245] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:42:55.573177 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c46cf0-cb83-4de1-8991-14d80e4b99cb None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:55.573485 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c46cf0-cb83-4de1-8991-14d80e4b99cb None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:55.574005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c46cf0-cb83-4de1-8991-14d80e4b99cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:55.597930 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-01c46cf0-cb83-4de1-8991-14d80e4b99cb None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:55.599123 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-01c46cf0-cb83-4de1-8991-14d80e4b99cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:55.619806 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:55.630138 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f3895-f6f2-4131-afa9-4d5c79667259 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:55.640501 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:55.670423 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173f2af-bc8d-489b-a019-4e46938934f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:55.671451 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173f2af-bc8d-489b-a019-4e46938934f5 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:55.671451 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173f2af-bc8d-489b-a019-4e46938934f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:55.671633 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173f2af-bc8d-489b-a019-4e46938934f5 None admin] PATH_INFO: `/v3/groups` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:55.672163 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173f2af-bc8d-489b-a019-4e46938934f5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:55.673663 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173f2af-bc8d-489b-a019-4e46938934f5 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:55.681780 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 120/246] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:42:55.682633 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c46cf0-cb83-4de1-8991-14d80e4b99cb None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:55.690518 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 127/247] 10.222.0.40 () {60 vars in 1134 bytes} [Sun Oct 30 00:42:55 2022] POST /identity/v3/groups => generated 226 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:42:55.795678 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c46cf0-cb83-4de1-8991-14d80e4b99cb None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:55.833007 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fcf51-2cbd-4acc-9ae1-b437ad51137d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:55.833667 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fcf51-2cbd-4acc-9ae1-b437ad51137d None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:55.833960 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fcf51-2cbd-4acc-9ae1-b437ad51137d None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:55.834210 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fcf51-2cbd-4acc-9ae1-b437ad51137d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:55.845314 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984fcf51-2cbd-4acc-9ae1-b437ad51137d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:42:55.850088 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-984fcf51-2cbd-4acc-9ae1-b437ad51137d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:42:55.850088 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:55.850088 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:42:55.850088 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:42:55.850088 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:42:55.850088 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:42:55.850088 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:42:55.850088 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:42:55.850088 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:42:55.850088 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:42:55.850088 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:42:55.850088 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:42:55.850088 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:42:55.850088 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:42:55.850088 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:42:55.850088 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:42:55.850950 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:42:55.850950 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:42:55.850950 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:42:55.850950 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:42:55.850950 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:42:55.850950 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:42:55.850950 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:42:55.850950 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:42:55.850950 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:42:55.850950 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:42:55.850950 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:42:55.850950 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:42:55.850950 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:42:55.850950 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:42:55.850950 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:42:55.850950 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:42:55.851741 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:42:55.851741 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:42:55.851741 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:42:55.851741 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:42:55.851741 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:42:55.851741 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:42:55.851741 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:42:55.851741 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:42:55.851741 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:42:55.851741 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:42:55.851741 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:42:55.851741 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:42:55.851741 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 121/248] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:42:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:42:55.857768 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173f2af-bc8d-489b-a019-4e46938934f5 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:55.951621 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fcf51-2cbd-4acc-9ae1-b437ad51137d None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:55.968854 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173f2af-bc8d-489b-a019-4e46938934f5 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:55.969783 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:56.011609 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e3f9f-7ac5-44e2-a139-a0d56ff05458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:56.013223 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e3f9f-7ac5-44e2-a139-a0d56ff05458 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:56.013852 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e3f9f-7ac5-44e2-a139-a0d56ff05458 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:56.014123 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e3f9f-7ac5-44e2-a139-a0d56ff05458 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:56.014787 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e3f9f-7ac5-44e2-a139-a0d56ff05458 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:56.015086 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e3f9f-7ac5-44e2-a139-a0d56ff05458 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:56.016726 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e3f9f-7ac5-44e2-a139-a0d56ff05458 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:56.029907 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 128/249] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Oct 30 00:42:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:56.032467 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e3f9f-7ac5-44e2-a139-a0d56ff05458 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:56.071021 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:56.086234 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fcf51-2cbd-4acc-9ae1-b437ad51137d None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:56.128681 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d2a67-bfe1-47ba-90b9-14d07929ae18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:56.129375 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d2a67-bfe1-47ba-90b9-14d07929ae18 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:56.129649 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d2a67-bfe1-47ba-90b9-14d07929ae18 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:56.129919 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d2a67-bfe1-47ba-90b9-14d07929ae18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:56.142611 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d2a67-bfe1-47ba-90b9-14d07929ae18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:42:56.149298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-a62d2a67-bfe1-47ba-90b9-14d07929ae18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:42:56.149298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:56.149298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:42:56.149298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:42:56.149298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:42:56.149298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:42:56.149298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:42:56.149298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:42:56.149298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:42:56.149298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:42:56.149298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:42:56.149298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:42:56.149298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:42:56.149298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:42:56.149298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:42:56.149298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:42:56.150191 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:42:56.150191 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:42:56.150191 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:42:56.150191 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:42:56.150191 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:42:56.150191 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:42:56.150191 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:42:56.150191 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:42:56.150191 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:42:56.150191 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:42:56.150191 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:42:56.150191 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:42:56.150191 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:42:56.150191 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:42:56.150191 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:42:56.150191 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:42:56.151180 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:42:56.151180 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:42:56.151180 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:42:56.151180 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:42:56.151180 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:42:56.151180 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:42:56.151180 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:42:56.151180 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:42:56.151180 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:42:56.151180 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:42:56.151180 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:42:56.151180 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:42:56.151180 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 122/250] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:42:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:42:56.156406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d2a67-bfe1-47ba-90b9-14d07929ae18 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:56.167376 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e3f9f-7ac5-44e2-a139-a0d56ff05458 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:56.207531 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524f1fa-a2c0-425c-82a2-98c733220b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:56.208164 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524f1fa-a2c0-425c-82a2-98c733220b60 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:56.208444 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524f1fa-a2c0-425c-82a2-98c733220b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:56.208716 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524f1fa-a2c0-425c-82a2-98c733220b60 None admin] PATH_INFO: `/v3/users/8eceb664a6f74b18b5c0c16fabab9bc8` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:56.209875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524f1fa-a2c0-425c-82a2-98c733220b60 None admin] RBAC: Authorizing `identity:get_user(user_id=8eceb664a6f74b18b5c0c16fabab9bc8)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:56.211326 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524f1fa-a2c0-425c-82a2-98c733220b60 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:56.213392 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 129/251] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:42:56 2022] GET /identity/v3/users/8eceb664a6f74b18b5c0c16fabab9bc8 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:42:56.219485 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524f1fa-a2c0-425c-82a2-98c733220b60 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:56.256337 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:56.288855 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d2a67-bfe1-47ba-90b9-14d07929ae18 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:56.333124 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afdd02-fc47-48e8-a329-c453c54a00fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:56.334093 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afdd02-fc47-48e8-a329-c453c54a00fd None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:56.334545 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afdd02-fc47-48e8-a329-c453c54a00fd None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:56.335042 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afdd02-fc47-48e8-a329-c453c54a00fd None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:56.337411 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afdd02-fc47-48e8-a329-c453c54a00fd None admin] RBAC: Adding query filter params (name=member) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:56.338043 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afdd02-fc47-48e8-a329-c453c54a00fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:56.339693 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afdd02-fc47-48e8-a329-c453c54a00fd None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:56.345438 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:56.349904 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524f1fa-a2c0-425c-82a2-98c733220b60 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:56.352516 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 123/252] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Oct 30 00:42:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:42:56.358378 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afdd02-fc47-48e8-a329-c453c54a00fd None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:56.393388 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463597b0-ed32-4e2a-9e42-0acf45c98a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:56.394211 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463597b0-ed32-4e2a-9e42-0acf45c98a8e None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:56.394496 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463597b0-ed32-4e2a-9e42-0acf45c98a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:56.394774 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463597b0-ed32-4e2a-9e42-0acf45c98a8e None admin] PATH_INFO: `/v3/system/users/8eceb664a6f74b18b5c0c16fabab9bc8/roles/bb8d5dabb95e46ef8120c17cbcca0566` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:56.396802 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463597b0-ed32-4e2a-9e42-0acf45c98a8e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8eceb664a6f74b18b5c0c16fabab9bc8, role_id=bb8d5dabb95e46ef8120c17cbcca0566)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:56.398236 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463597b0-ed32-4e2a-9e42-0acf45c98a8e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:56.410533 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 130/253] 10.222.0.40 () {58 vars in 1334 bytes} [Sun Oct 30 00:42:56 2022] PUT /identity/v3/system/users/8eceb664a6f74b18b5c0c16fabab9bc8/roles/bb8d5dabb95e46ef8120c17cbcca0566 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:42:56.485576 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afdd02-fc47-48e8-a329-c453c54a00fd None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:56.527853 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81803b-865e-4c1a-952b-9745764aad18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:56.528942 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81803b-865e-4c1a-952b-9745764aad18 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:56.529463 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81803b-865e-4c1a-952b-9745764aad18 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:56.530068 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81803b-865e-4c1a-952b-9745764aad18 None admin] PATH_INFO: `/v3/users/d3028f181b6e4bd9abc1ce3432603f85` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:56.531471 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81803b-865e-4c1a-952b-9745764aad18 None admin] RBAC: Authorizing `identity:get_user(user_id=d3028f181b6e4bd9abc1ce3432603f85)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:56.533143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81803b-865e-4c1a-952b-9745764aad18 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:56.540277 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 124/254] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:42:56 2022] GET /identity/v3/users/d3028f181b6e4bd9abc1ce3432603f85 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:56.541422 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463597b0-ed32-4e2a-9e42-0acf45c98a8e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:56.665919 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463597b0-ed32-4e2a-9e42-0acf45c98a8e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:56.709853 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62757d-373e-4374-a5ab-cd7536f2cd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:56.710718 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62757d-373e-4374-a5ab-cd7536f2cd99 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:56.711142 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62757d-373e-4374-a5ab-cd7536f2cd99 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:56.711655 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62757d-373e-4374-a5ab-cd7536f2cd99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:56.712532 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b62757d-373e-4374-a5ab-cd7536f2cd99 None admin] RBAC: Adding query filter params (role.id=a2f2dde26304402eb433d8d8cfaca1e7, user.id=d3028f181b6e4bd9abc1ce3432603f85, scope.system=all) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:56.713017 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b62757d-373e-4374-a5ab-cd7536f2cd99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:56.714669 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b62757d-373e-4374-a5ab-cd7536f2cd99 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:56.730372 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 131/255] 10.222.0.40 () {56 vars in 1308 bytes} [Sun Oct 30 00:42:56 2022] GET /identity/v3/role_assignments?user.id=d3028f181b6e4bd9abc1ce3432603f85&scope.system=all&role.id=a2f2dde26304402eb433d8d8cfaca1e7 => generated 510 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:58.186762 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8cc38-b10e-428d-925f-b6bb2f9f63e1 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:58.187284 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8cc38-b10e-428d-925f-b6bb2f9f63e1 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:58.187284 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8cc38-b10e-428d-925f-b6bb2f9f63e1 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:58.188623 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 125/256] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:58.194454 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651f184-02f6-448b-901c-c6d6df440a2e None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:58.194866 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651f184-02f6-448b-901c-c6d6df440a2e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:58.195044 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651f184-02f6-448b-901c-c6d6df440a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:58.215045 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-9651f184-02f6-448b-901c-c6d6df440a2e None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:58.216843 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9651f184-02f6-448b-901c-c6d6df440a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:58.234064 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:58.289678 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 132/257] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 30 00:42:58.664077 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8cc38-b10e-428d-925f-b6bb2f9f63e1 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:58.683191 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:58.689272 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8cc38-b10e-428d-925f-b6bb2f9f63e1 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:58.696426 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753adebe-f615-47f1-ac9d-35171cd32729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:58.697336 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753adebe-f615-47f1-ac9d-35171cd32729 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:58.697832 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753adebe-f615-47f1-ac9d-35171cd32729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:58.698297 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753adebe-f615-47f1-ac9d-35171cd32729 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:58.722082 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753adebe-f615-47f1-ac9d-35171cd32729 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:42:58.727274 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-753adebe-f615-47f1-ac9d-35171cd32729 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:42:58.727274 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:58.727274 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:42:58.727274 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:42:58.727274 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:42:58.727274 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:42:58.727274 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:42:58.727274 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:42:58.727274 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:42:58.727274 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:42:58.727274 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:42:58.727274 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:42:58.727274 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:42:58.727274 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:42:58.727274 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:42:58.727274 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:42:58.728124 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:42:58.728124 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:42:58.728124 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:42:58.728124 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:42:58.728124 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:42:58.728124 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:42:58.728124 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:42:58.728124 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:42:58.728124 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:42:58.728124 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:42:58.728124 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:42:58.728124 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:42:58.728124 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:42:58.728124 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:42:58.728124 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:42:58.728124 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:42:58.728925 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:42:58.728925 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:42:58.728925 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:42:58.728925 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:42:58.728925 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:42:58.728925 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:42:58.728925 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:42:58.728925 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:42:58.728925 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:42:58.728925 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:42:58.728925 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:42:58.728925 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:42:58.731260 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 126/258] 10.222.0.40 () {56 vars in 1120 bytes} [Sun Oct 30 00:42:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:42:58.737279 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651f184-02f6-448b-901c-c6d6df440a2e None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:58.754663 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651f184-02f6-448b-901c-c6d6df440a2e None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:58.765002 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928a413-e576-4363-8dfe-d23e9bbd8295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:58.765661 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928a413-e576-4363-8dfe-d23e9bbd8295 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:58.765935 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928a413-e576-4363-8dfe-d23e9bbd8295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:58.766202 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928a413-e576-4363-8dfe-d23e9bbd8295 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:58.766871 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928a413-e576-4363-8dfe-d23e9bbd8295 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:58.767164 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928a413-e576-4363-8dfe-d23e9bbd8295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:58.768976 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: WARNING py.warnings [None req-2928a413-e576-4363-8dfe-d23e9bbd8295 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:42:58.768976 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: warnings.warn(msg) Oct 30 00:42:58.768976 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: Oct 30 00:42:58.769924 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928a413-e576-4363-8dfe-d23e9bbd8295 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:58.785645 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 133/259] 10.222.0.40 () {56 vars in 1122 bytes} [Sun Oct 30 00:42:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:58.791350 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753adebe-f615-47f1-ac9d-35171cd32729 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:58.804770 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753adebe-f615-47f1-ac9d-35171cd32729 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:58.811092 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02956406-82de-44e5-90a8-66440b5edd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:58.812078 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02956406-82de-44e5-90a8-66440b5edd3a admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:58.812574 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02956406-82de-44e5-90a8-66440b5edd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:58.813035 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02956406-82de-44e5-90a8-66440b5edd3a admin admin] PATH_INFO: `/v3/groups/8fd4d47eec0847e4ad6b7862453dcf20` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:58.820249 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02956406-82de-44e5-90a8-66440b5edd3a admin admin] RBAC: Authorizing `identity:get_group(group_id=8fd4d47eec0847e4ad6b7862453dcf20)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:58.822346 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: WARNING py.warnings [None req-02956406-82de-44e5-90a8-66440b5edd3a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:42:58.822346 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: warnings.warn(msg) Oct 30 00:42:58.822346 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: Oct 30 00:42:58.824011 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02956406-82de-44e5-90a8-66440b5edd3a admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:58.826455 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 127/260] 10.222.0.40 () {56 vars in 1201 bytes} [Sun Oct 30 00:42:58 2022] GET /identity/v3/groups/8fd4d47eec0847e4ad6b7862453dcf20 => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:58.832227 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928a413-e576-4363-8dfe-d23e9bbd8295 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:58.847654 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928a413-e576-4363-8dfe-d23e9bbd8295 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:58.853181 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de47a7-afcd-4207-ad45-2c6b54fe5774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:58.853823 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de47a7-afcd-4207-ad45-2c6b54fe5774 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:58.854098 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de47a7-afcd-4207-ad45-2c6b54fe5774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:58.854364 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de47a7-afcd-4207-ad45-2c6b54fe5774 admin admin] PATH_INFO: `/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:58.857876 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de47a7-afcd-4207-ad45-2c6b54fe5774 admin admin] RBAC: Authorizing `identity:get_project(project_id=bbcd0ae183934d41a9caeb3d9450db6e)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:58.859954 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de47a7-afcd-4207-ad45-2c6b54fe5774 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:58.861918 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 134/261] 10.222.0.40 () {56 vars in 1207 bytes} [Sun Oct 30 00:42:58 2022] GET /identity/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:42:58.867654 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02956406-82de-44e5-90a8-66440b5edd3a admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:58.878605 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02956406-82de-44e5-90a8-66440b5edd3a admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:58.890100 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e31b7-da49-4d59-be15-726318a9854d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:58.891052 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e31b7-da49-4d59-be15-726318a9854d admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:58.891555 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e31b7-da49-4d59-be15-726318a9854d admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:58.892020 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e31b7-da49-4d59-be15-726318a9854d admin admin] PATH_INFO: `/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e/groups/8fd4d47eec0847e4ad6b7862453dcf20/roles/a2f2dde26304402eb433d8d8cfaca1e7` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:58.894157 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e31b7-da49-4d59-be15-726318a9854d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbcd0ae183934d41a9caeb3d9450db6e, group_id=8fd4d47eec0847e4ad6b7862453dcf20, role_id=a2f2dde26304402eb433d8d8cfaca1e7)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:58.895467 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: WARNING py.warnings [None req-186e31b7-da49-4d59-be15-726318a9854d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:42:58.895467 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: warnings.warn(msg) Oct 30 00:42:58.895467 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: Oct 30 00:42:58.897852 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e31b7-da49-4d59-be15-726318a9854d admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:58.917789 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 128/262] 10.222.0.40 () {58 vars in 1463 bytes} [Sun Oct 30 00:42:58 2022] PUT /identity/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e/groups/8fd4d47eec0847e4ad6b7862453dcf20/roles/a2f2dde26304402eb433d8d8cfaca1e7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:42:58.991675 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197ca5b-b14e-46fa-b33e-eb384b0ba210 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:58.991998 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197ca5b-b14e-46fa-b33e-eb384b0ba210 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:58.992225 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197ca5b-b14e-46fa-b33e-eb384b0ba210 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:58.993866 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 135/263] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:58.999752 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead213d-66c4-44d4-910a-122e6388b59d None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:59.000322 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead213d-66c4-44d4-910a-122e6388b59d None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:59.000794 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead213d-66c4-44d4-910a-122e6388b59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:59.025091 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-7ead213d-66c4-44d4-910a-122e6388b59d None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:59.026753 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-7ead213d-66c4-44d4-910a-122e6388b59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:59.115835 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 129/264] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 30 00:42:59.240899 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e669e1-1485-4c8b-a1b4-4144e0ea2a72 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:59.241401 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e669e1-1485-4c8b-a1b4-4144e0ea2a72 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:59.241401 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e669e1-1485-4c8b-a1b4-4144e0ea2a72 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:59.242963 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 136/265] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:59.249472 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d44e7f-793b-4b7c-a711-9c7c77d886bc None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:59.250377 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d44e7f-793b-4b7c-a711-9c7c77d886bc None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:59.250655 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d44e7f-793b-4b7c-a711-9c7c77d886bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:59.275167 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-e8d44e7f-793b-4b7c-a711-9c7c77d886bc None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:59.276429 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-e8d44e7f-793b-4b7c-a711-9c7c77d886bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:59.355548 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 130/266] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:42:59.558613 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e669e1-1485-4c8b-a1b4-4144e0ea2a72 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:59.573387 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e669e1-1485-4c8b-a1b4-4144e0ea2a72 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:59.577879 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62ddae-0dab-405c-9116-c31bbb6f8aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:59.578496 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62ddae-0dab-405c-9116-c31bbb6f8aab admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:59.578768 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62ddae-0dab-405c-9116-c31bbb6f8aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:59.579039 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62ddae-0dab-405c-9116-c31bbb6f8aab admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:59.591153 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a62ddae-0dab-405c-9116-c31bbb6f8aab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:42:59.597185 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-5a62ddae-0dab-405c-9116-c31bbb6f8aab admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:42:59.597185 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:42:59.597185 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:42:59.597185 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:42:59.597185 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:42:59.597185 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:42:59.597185 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:42:59.597185 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:42:59.597185 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:42:59.597185 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:42:59.597185 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:42:59.597185 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:42:59.597185 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:42:59.597185 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:42:59.597185 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:42:59.597185 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:42:59.598078 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:42:59.598078 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:42:59.598078 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:42:59.598078 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:42:59.598078 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:42:59.598078 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:42:59.598078 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:42:59.598078 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:42:59.598078 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:42:59.598078 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:42:59.598078 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:42:59.598078 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:42:59.598078 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:42:59.598078 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:42:59.598078 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:42:59.598078 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:42:59.598873 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:42:59.598873 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:42:59.598873 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:42:59.598873 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:42:59.598873 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:42:59.598873 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:42:59.598873 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:42:59.598873 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:42:59.598873 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:42:59.598873 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:42:59.598873 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:42:59.598873 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:42:59.598873 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 137/267] 10.222.0.40 () {56 vars in 1135 bytes} [Sun Oct 30 00:42:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:42:59.604163 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d44e7f-793b-4b7c-a711-9c7c77d886bc None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:59.626243 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d44e7f-793b-4b7c-a711-9c7c77d886bc None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:59.631684 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c50d73-4755-4e4d-a204-41a3a47ac898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:59.632291 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c50d73-4755-4e4d-a204-41a3a47ac898 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:59.632566 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c50d73-4755-4e4d-a204-41a3a47ac898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:59.632840 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c50d73-4755-4e4d-a204-41a3a47ac898 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:59.633538 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c50d73-4755-4e4d-a204-41a3a47ac898 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:42:59.633835 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c50d73-4755-4e4d-a204-41a3a47ac898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:59.634847 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: WARNING py.warnings [None req-52c50d73-4755-4e4d-a204-41a3a47ac898 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:42:59.634847 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: warnings.warn(msg) Oct 30 00:42:59.634847 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: Oct 30 00:42:59.635752 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c50d73-4755-4e4d-a204-41a3a47ac898 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:59.648956 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 131/268] 10.222.0.40 () {56 vars in 1132 bytes} [Sun Oct 30 00:42:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:59.655570 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62ddae-0dab-405c-9116-c31bbb6f8aab admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:59.667772 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62ddae-0dab-405c-9116-c31bbb6f8aab admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:59.674433 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecb2fb-0d80-488f-aa9f-833985c7b348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:59.675104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecb2fb-0d80-488f-aa9f-833985c7b348 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:59.675375 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecb2fb-0d80-488f-aa9f-833985c7b348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:59.675700 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecb2fb-0d80-488f-aa9f-833985c7b348 admin admin] PATH_INFO: `/v3/groups/8fd4d47eec0847e4ad6b7862453dcf20` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:59.677424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ecb2fb-0d80-488f-aa9f-833985c7b348 admin admin] RBAC: Authorizing `identity:get_group(group_id=8fd4d47eec0847e4ad6b7862453dcf20)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:59.678488 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: WARNING py.warnings [None req-d9ecb2fb-0d80-488f-aa9f-833985c7b348 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:42:59.678488 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: warnings.warn(msg) Oct 30 00:42:59.678488 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: Oct 30 00:42:59.679754 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ecb2fb-0d80-488f-aa9f-833985c7b348 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:59.684311 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 138/269] 10.222.0.40 () {56 vars in 1201 bytes} [Sun Oct 30 00:42:59 2022] GET /identity/v3/groups/8fd4d47eec0847e4ad6b7862453dcf20 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:59.687491 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c50d73-4755-4e4d-a204-41a3a47ac898 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:59.706251 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c50d73-4755-4e4d-a204-41a3a47ac898 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:59.718363 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d497d-440c-45b1-914f-dd4e34a2cd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:59.719275 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d497d-440c-45b1-914f-dd4e34a2cd56 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:59.719749 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d497d-440c-45b1-914f-dd4e34a2cd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:59.720215 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d497d-440c-45b1-914f-dd4e34a2cd56 admin admin] PATH_INFO: `/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:59.725863 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d497d-440c-45b1-914f-dd4e34a2cd56 admin admin] RBAC: Authorizing `identity:get_project(project_id=bbcd0ae183934d41a9caeb3d9450db6e)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:59.728142 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d497d-440c-45b1-914f-dd4e34a2cd56 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:59.730301 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 132/270] 10.222.0.40 () {56 vars in 1207 bytes} [Sun Oct 30 00:42:59 2022] GET /identity/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:42:59.736472 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecb2fb-0d80-488f-aa9f-833985c7b348 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:59.751335 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecb2fb-0d80-488f-aa9f-833985c7b348 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:59.757165 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95ce27-0d32-4052-a811-de93a66c6ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:59.757892 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95ce27-0d32-4052-a811-de93a66c6ed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:59.758161 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95ce27-0d32-4052-a811-de93a66c6ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:59.758424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95ce27-0d32-4052-a811-de93a66c6ed2 admin admin] PATH_INFO: `/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e/groups/8fd4d47eec0847e4ad6b7862453dcf20/roles/b63857cb2ff04d189523309091368e81` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:59.761947 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95ce27-0d32-4052-a811-de93a66c6ed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbcd0ae183934d41a9caeb3d9450db6e, group_id=8fd4d47eec0847e4ad6b7862453dcf20, role_id=b63857cb2ff04d189523309091368e81)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:59.763837 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: WARNING py.warnings [None req-ad95ce27-0d32-4052-a811-de93a66c6ed2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:42:59.763837 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: warnings.warn(msg) Oct 30 00:42:59.763837 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: Oct 30 00:42:59.766004 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95ce27-0d32-4052-a811-de93a66c6ed2 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:59.787532 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 139/271] 10.222.0.40 () {58 vars in 1463 bytes} [Sun Oct 30 00:42:59 2022] PUT /identity/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e/groups/8fd4d47eec0847e4ad6b7862453dcf20/roles/b63857cb2ff04d189523309091368e81 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:42:59.891371 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d497d-440c-45b1-914f-dd4e34a2cd56 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:59.933586 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:00.018580 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d497d-440c-45b1-914f-dd4e34a2cd56 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:00.063070 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83a7d3-7185-4c79-a62a-19bf33f40442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:00.063716 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83a7d3-7185-4c79-a62a-19bf33f40442 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:00.063993 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83a7d3-7185-4c79-a62a-19bf33f40442 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:00.064260 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83a7d3-7185-4c79-a62a-19bf33f40442 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:00.080765 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a83a7d3-7185-4c79-a62a-19bf33f40442 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:43:00.086235 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-5a83a7d3-7185-4c79-a62a-19bf33f40442 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:43:00.086235 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:00.086235 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:00.086235 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:00.086235 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:00.086235 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:00.086235 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:00.086235 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:00.086235 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:00.086235 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:00.086235 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:00.086235 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:00.086235 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:43:00.086235 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:43:00.086235 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:43:00.086235 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:43:00.087101 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:43:00.087101 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:43:00.087101 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:43:00.087101 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:43:00.087101 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:00.087101 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:00.087101 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:00.087101 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:00.087101 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:00.087101 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:00.087101 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:00.087101 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:00.087101 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:00.087101 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:00.087101 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:00.087101 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:00.087897 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:00.087897 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:00.087897 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:00.087897 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:00.087897 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:43:00.087897 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:43:00.087897 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:43:00.087897 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:43:00.087897 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:43:00.087897 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:43:00.087897 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:43:00.087897 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:00.087897 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 133/272] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:42:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:00.094037 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95ce27-0d32-4052-a811-de93a66c6ed2 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:00.210883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95ce27-0d32-4052-a811-de93a66c6ed2 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:00.225933 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d9761-a273-40b9-a3e7-914ab7a22028 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:00.226523 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d9761-a273-40b9-a3e7-914ab7a22028 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:00.226985 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d9761-a273-40b9-a3e7-914ab7a22028 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:00.228785 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 134/273] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:00.244537 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:00.245816 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fe447-ab46-44d2-892c-e8fde0a829b3 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:00.246315 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fe447-ab46-44d2-892c-e8fde0a829b3 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:00.246893 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fe447-ab46-44d2-892c-e8fde0a829b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:00.260433 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daada883-b187-439c-92d6-8512c3621f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:00.261047 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daada883-b187-439c-92d6-8512c3621f06 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:00.261493 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daada883-b187-439c-92d6-8512c3621f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:00.261785 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daada883-b187-439c-92d6-8512c3621f06 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:00.262510 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daada883-b187-439c-92d6-8512c3621f06 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:00.262817 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daada883-b187-439c-92d6-8512c3621f06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:00.264541 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daada883-b187-439c-92d6-8512c3621f06 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:00.279149 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 140/274] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Oct 30 00:43:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:00.286267 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-c53fe447-ab46-44d2-892c-e8fde0a829b3 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:00.286759 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daada883-b187-439c-92d6-8512c3621f06 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:00.288261 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c53fe447-ab46-44d2-892c-e8fde0a829b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:00.422633 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 135/275] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 30 00:43:00.464928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daada883-b187-439c-92d6-8512c3621f06 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:00.516813 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783bb14-7bc5-4650-aac8-15f16cfc8070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:00.517482 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783bb14-7bc5-4650-aac8-15f16cfc8070 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:00.517813 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783bb14-7bc5-4650-aac8-15f16cfc8070 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:00.518091 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783bb14-7bc5-4650-aac8-15f16cfc8070 None admin] PATH_INFO: `/v3/users/8eceb664a6f74b18b5c0c16fabab9bc8` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:00.520296 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783bb14-7bc5-4650-aac8-15f16cfc8070 None admin] RBAC: Authorizing `identity:get_user(user_id=8eceb664a6f74b18b5c0c16fabab9bc8)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:00.521835 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783bb14-7bc5-4650-aac8-15f16cfc8070 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:00.524013 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 141/276] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:43:00 2022] GET /identity/v3/users/8eceb664a6f74b18b5c0c16fabab9bc8 => generated 293 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:00.529694 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fe447-ab46-44d2-892c-e8fde0a829b3 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:00.603407 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:00.674889 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fe447-ab46-44d2-892c-e8fde0a829b3 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:00.722711 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e8808-7200-4f20-bea0-01b75e07de7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:00.723231 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e8808-7200-4f20-bea0-01b75e07de7e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:00.723499 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e8808-7200-4f20-bea0-01b75e07de7e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:00.723759 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e8808-7200-4f20-bea0-01b75e07de7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:00.724478 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e8808-7200-4f20-bea0-01b75e07de7e None admin] RBAC: Adding query filter params (role.id=bb8d5dabb95e46ef8120c17cbcca0566, user.id=8eceb664a6f74b18b5c0c16fabab9bc8, scope.system=all) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:00.724776 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e8808-7200-4f20-bea0-01b75e07de7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:00.727951 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e8808-7200-4f20-bea0-01b75e07de7e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:00.741016 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 136/277] 10.222.0.40 () {56 vars in 1308 bytes} [Sun Oct 30 00:43:00 2022] GET /identity/v3/role_assignments?user.id=8eceb664a6f74b18b5c0c16fabab9bc8&scope.system=all&role.id=bb8d5dabb95e46ef8120c17cbcca0566 => generated 510 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:00.946050 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783bb14-7bc5-4650-aac8-15f16cfc8070 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:00.957468 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783bb14-7bc5-4650-aac8-15f16cfc8070 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:00.961974 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57047c47-61ce-4978-b60e-f10b0a9534f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:00.962608 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57047c47-61ce-4978-b60e-f10b0a9534f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:00.962877 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57047c47-61ce-4978-b60e-f10b0a9534f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:00.963141 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57047c47-61ce-4978-b60e-f10b0a9534f6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:00.980832 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57047c47-61ce-4978-b60e-f10b0a9534f6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:43:00.986254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-57047c47-61ce-4978-b60e-f10b0a9534f6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:43:00.986254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:00.986254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:00.986254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:00.986254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:00.986254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:00.986254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:00.986254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:00.986254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:00.986254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:00.986254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:00.986254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:00.986254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:43:00.986254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:43:00.986254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:43:00.986254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:43:00.987153 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:43:00.987153 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:43:00.987153 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:43:00.987153 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:43:00.987153 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:00.987153 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:00.987153 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:00.987153 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:00.987153 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:00.987153 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:00.987153 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:00.987153 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:00.987153 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:00.987153 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:00.987153 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:00.987153 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:00.987939 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:00.987939 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:00.987939 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:00.987939 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:00.987939 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:43:00.987939 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:43:00.987939 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:43:00.987939 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:43:00.987939 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:43:00.987939 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:43:00.987939 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:43:00.987939 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:00.987939 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 142/278] 10.222.0.40 () {56 vars in 1120 bytes} [Sun Oct 30 00:43:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:00.993295 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e8808-7200-4f20-bea0-01b75e07de7e None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:01.006876 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e8808-7200-4f20-bea0-01b75e07de7e None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:01.011390 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267aa6d-0765-4919-a945-bf83e303066b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:01.011998 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267aa6d-0765-4919-a945-bf83e303066b admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:01.012305 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267aa6d-0765-4919-a945-bf83e303066b admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:01.012570 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267aa6d-0765-4919-a945-bf83e303066b admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:01.013259 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267aa6d-0765-4919-a945-bf83e303066b admin admin] RBAC: Adding query filter params (name=member) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:01.013557 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267aa6d-0765-4919-a945-bf83e303066b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:01.015236 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267aa6d-0765-4919-a945-bf83e303066b admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:01.027046 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 137/279] 10.222.0.40 () {56 vars in 1122 bytes} [Sun Oct 30 00:43:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:01.033373 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57047c47-61ce-4978-b60e-f10b0a9534f6 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:01.045771 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57047c47-61ce-4978-b60e-f10b0a9534f6 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:01.050590 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a45066-6015-4624-8d09-5f8e90787046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:01.051327 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a45066-6015-4624-8d09-5f8e90787046 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:01.051605 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a45066-6015-4624-8d09-5f8e90787046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:01.051874 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a45066-6015-4624-8d09-5f8e90787046 admin admin] PATH_INFO: `/v3/groups/8fd4d47eec0847e4ad6b7862453dcf20` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:01.053148 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a45066-6015-4624-8d09-5f8e90787046 admin admin] RBAC: Authorizing `identity:get_group(group_id=8fd4d47eec0847e4ad6b7862453dcf20)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:01.054646 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ab8d9-174d-4964-9905-8b4a0262f352 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:01.054921 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ab8d9-174d-4964-9905-8b4a0262f352 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:01.055292 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ab8d9-174d-4964-9905-8b4a0262f352 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:01.056760 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 138/280] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:43:01.058835 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a45066-6015-4624-8d09-5f8e90787046 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:01.061278 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 143/281] 10.222.0.40 () {56 vars in 1201 bytes} [Sun Oct 30 00:43:01 2022] GET /identity/v3/groups/8fd4d47eec0847e4ad6b7862453dcf20 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:01.065544 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997b33c-fe63-42d6-9a3d-9288641d425f None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:01.065937 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997b33c-fe63-42d6-9a3d-9288641d425f None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:01.066216 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997b33c-fe63-42d6-9a3d-9288641d425f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:01.074573 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a45066-6015-4624-8d09-5f8e90787046 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:01.099928 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-8997b33c-fe63-42d6-9a3d-9288641d425f None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:01.100576 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a45066-6015-4624-8d09-5f8e90787046 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:01.101145 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8997b33c-fe63-42d6-9a3d-9288641d425f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:01.106871 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b33bf-97b4-4ee9-a6ad-0275b6af21cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:01.108005 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b33bf-97b4-4ee9-a6ad-0275b6af21cf admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:01.108283 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b33bf-97b4-4ee9-a6ad-0275b6af21cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:01.108613 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b33bf-97b4-4ee9-a6ad-0275b6af21cf admin admin] PATH_INFO: `/v3/projects/88c423a2de7d46ff97e231261ac80890` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:01.109956 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b33bf-97b4-4ee9-a6ad-0275b6af21cf admin admin] RBAC: Authorizing `identity:get_project(project_id=88c423a2de7d46ff97e231261ac80890)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:01.110393 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 139/282] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 30 00:43:01.112000 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b33bf-97b4-4ee9-a6ad-0275b6af21cf admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:01.113688 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 144/283] 10.222.0.40 () {56 vars in 1207 bytes} [Sun Oct 30 00:43:01 2022] GET /identity/v3/projects/88c423a2de7d46ff97e231261ac80890 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:01.119572 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997b33c-fe63-42d6-9a3d-9288641d425f None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:01.130039 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997b33c-fe63-42d6-9a3d-9288641d425f None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:01.135871 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04d71f-e60d-459e-a5cd-3b2c0ae4c596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:01.136750 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04d71f-e60d-459e-a5cd-3b2c0ae4c596 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:01.137092 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04d71f-e60d-459e-a5cd-3b2c0ae4c596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:01.137996 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04d71f-e60d-459e-a5cd-3b2c0ae4c596 admin admin] PATH_INFO: `/v3/projects/88c423a2de7d46ff97e231261ac80890/groups/8fd4d47eec0847e4ad6b7862453dcf20/roles/a2f2dde26304402eb433d8d8cfaca1e7` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:01.140077 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04d71f-e60d-459e-a5cd-3b2c0ae4c596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c423a2de7d46ff97e231261ac80890, group_id=8fd4d47eec0847e4ad6b7862453dcf20, role_id=a2f2dde26304402eb433d8d8cfaca1e7)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:01.142918 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04d71f-e60d-459e-a5cd-3b2c0ae4c596 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:01.161875 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 140/284] 10.222.0.40 () {58 vars in 1463 bytes} [Sun Oct 30 00:43:01 2022] PUT /identity/v3/projects/88c423a2de7d46ff97e231261ac80890/groups/8fd4d47eec0847e4ad6b7862453dcf20/roles/a2f2dde26304402eb433d8d8cfaca1e7 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:43:01.433701 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f708a-358a-4547-8cab-e706ae2aac1b None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:01.434569 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f708a-358a-4547-8cab-e706ae2aac1b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:01.435065 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f708a-358a-4547-8cab-e706ae2aac1b None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:01.436627 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 145/285] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:01.441944 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e717d-1fde-4630-b8d1-8678397eb118 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:01.442349 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e717d-1fde-4630-b8d1-8678397eb118 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:01.442477 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e717d-1fde-4630-b8d1-8678397eb118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:01.466016 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-d81e717d-1fde-4630-b8d1-8678397eb118 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:01.467447 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-d81e717d-1fde-4630-b8d1-8678397eb118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:01.519140 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f708a-358a-4547-8cab-e706ae2aac1b None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:01.542907 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 141/286] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 30 00:43:01.587474 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:01.621209 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f708a-358a-4547-8cab-e706ae2aac1b None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:01.626678 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720cdfce-0545-45e4-92a0-f669b04daf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:01.627307 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cdfce-0545-45e4-92a0-f669b04daf15 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:01.627577 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cdfce-0545-45e4-92a0-f669b04daf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:01.627889 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cdfce-0545-45e4-92a0-f669b04daf15 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:01.641428 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720cdfce-0545-45e4-92a0-f669b04daf15 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:43:01.646333 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-720cdfce-0545-45e4-92a0-f669b04daf15 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:43:01.646333 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:01.646333 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:01.646333 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:01.646333 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:01.646333 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:01.646333 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:01.646333 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:01.646333 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:01.646333 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:01.646333 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:01.646333 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:01.646333 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:43:01.646333 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:43:01.646333 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:43:01.646333 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:43:01.647211 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:43:01.647211 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:43:01.647211 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:43:01.647211 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:43:01.647211 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:01.647211 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:01.647211 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:01.647211 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:01.647211 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:01.647211 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:01.647211 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:01.647211 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:01.647211 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:01.647211 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:01.647211 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:01.647211 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:01.648008 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:01.648008 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:01.648008 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:01.648008 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:01.648008 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:43:01.648008 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:43:01.648008 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:43:01.648008 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:43:01.648008 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:43:01.648008 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:43:01.648008 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:43:01.648008 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:01.651043 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 146/287] 10.222.0.40 () {56 vars in 1135 bytes} [Sun Oct 30 00:43:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 129 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:43:01.654248 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e717d-1fde-4630-b8d1-8678397eb118 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:01.664505 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e717d-1fde-4630-b8d1-8678397eb118 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:01.678621 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697f404-c2b3-494f-ad6c-b63d77d086f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:01.679240 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697f404-c2b3-494f-ad6c-b63d77d086f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:01.679563 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697f404-c2b3-494f-ad6c-b63d77d086f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:01.679840 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697f404-c2b3-494f-ad6c-b63d77d086f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:01.680511 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697f404-c2b3-494f-ad6c-b63d77d086f2 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:01.680802 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697f404-c2b3-494f-ad6c-b63d77d086f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:01.682433 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697f404-c2b3-494f-ad6c-b63d77d086f2 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:01.692554 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 142/288] 10.222.0.40 () {56 vars in 1132 bytes} [Sun Oct 30 00:43:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:01.698112 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720cdfce-0545-45e4-92a0-f669b04daf15 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:01.712094 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720cdfce-0545-45e4-92a0-f669b04daf15 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:01.718746 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700ddbd-a6a7-431a-8f12-304654da6a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:01.719414 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700ddbd-a6a7-431a-8f12-304654da6a87 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:01.719688 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700ddbd-a6a7-431a-8f12-304654da6a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:01.720007 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700ddbd-a6a7-431a-8f12-304654da6a87 admin admin] PATH_INFO: `/v3/groups/8fd4d47eec0847e4ad6b7862453dcf20` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:01.721168 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d700ddbd-a6a7-431a-8f12-304654da6a87 admin admin] RBAC: Authorizing `identity:get_group(group_id=8fd4d47eec0847e4ad6b7862453dcf20)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:01.723166 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d700ddbd-a6a7-431a-8f12-304654da6a87 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:01.724999 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 147/289] 10.222.0.40 () {56 vars in 1201 bytes} [Sun Oct 30 00:43:01 2022] GET /identity/v3/groups/8fd4d47eec0847e4ad6b7862453dcf20 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:01.730662 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697f404-c2b3-494f-ad6c-b63d77d086f2 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:01.741955 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697f404-c2b3-494f-ad6c-b63d77d086f2 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:01.749402 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98a0f9-86fa-4f80-b764-19af006b4dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:01.750024 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98a0f9-86fa-4f80-b764-19af006b4dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:01.750298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98a0f9-86fa-4f80-b764-19af006b4dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:01.750615 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98a0f9-86fa-4f80-b764-19af006b4dc8 admin admin] PATH_INFO: `/v3/projects/88c423a2de7d46ff97e231261ac80890` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:01.751984 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98a0f9-86fa-4f80-b764-19af006b4dc8 admin admin] RBAC: Authorizing `identity:get_project(project_id=88c423a2de7d46ff97e231261ac80890)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:01.754237 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98a0f9-86fa-4f80-b764-19af006b4dc8 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:01.755890 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 143/290] 10.222.0.40 () {56 vars in 1207 bytes} [Sun Oct 30 00:43:01 2022] GET /identity/v3/projects/88c423a2de7d46ff97e231261ac80890 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:01.761896 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700ddbd-a6a7-431a-8f12-304654da6a87 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:01.773295 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700ddbd-a6a7-431a-8f12-304654da6a87 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:01.780259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594e110-f1c4-4257-817b-3f1c97fdab6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:01.780894 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594e110-f1c4-4257-817b-3f1c97fdab6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:01.781225 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594e110-f1c4-4257-817b-3f1c97fdab6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:01.781502 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594e110-f1c4-4257-817b-3f1c97fdab6a admin admin] PATH_INFO: `/v3/projects/88c423a2de7d46ff97e231261ac80890/groups/8fd4d47eec0847e4ad6b7862453dcf20/roles/b63857cb2ff04d189523309091368e81` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:01.783816 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594e110-f1c4-4257-817b-3f1c97fdab6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c423a2de7d46ff97e231261ac80890, group_id=8fd4d47eec0847e4ad6b7862453dcf20, role_id=b63857cb2ff04d189523309091368e81)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:01.786562 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594e110-f1c4-4257-817b-3f1c97fdab6a admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:01.806768 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 148/291] 10.222.0.40 () {58 vars in 1463 bytes} [Sun Oct 30 00:43:01 2022] PUT /identity/v3/projects/88c423a2de7d46ff97e231261ac80890/groups/8fd4d47eec0847e4ad6b7862453dcf20/roles/b63857cb2ff04d189523309091368e81 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:43:01.867786 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98a0f9-86fa-4f80-b764-19af006b4dc8 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:01.878181 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:01.887059 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98a0f9-86fa-4f80-b764-19af006b4dc8 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:01.977710 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88bac4-3da8-441f-977c-e7736b4935ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:01.978274 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88bac4-3da8-441f-977c-e7736b4935ae admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:01.978546 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88bac4-3da8-441f-977c-e7736b4935ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:01.978814 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88bac4-3da8-441f-977c-e7736b4935ae admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:01.992612 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88bac4-3da8-441f-977c-e7736b4935ae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:43:02.003504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-4d88bac4-3da8-441f-977c-e7736b4935ae admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:43:02.003504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:02.003504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:02.003504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:02.003504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:02.003504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:02.003504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:02.003504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:02.003504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:02.003504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:02.003504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:02.003504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:02.003504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:43:02.003504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:43:02.003504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:43:02.003504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:43:02.005994 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:43:02.005994 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:43:02.005994 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:43:02.005994 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:43:02.005994 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:02.005994 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:02.005994 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:02.005994 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:02.005994 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:02.005994 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:02.005994 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:02.005994 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:02.005994 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:02.005994 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:02.005994 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:02.005994 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:02.007951 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:02.007951 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:02.007951 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:02.007951 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:02.007951 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:43:02.007951 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:43:02.007951 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:43:02.007951 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:43:02.007951 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:43:02.007951 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:43:02.007951 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:43:02.007951 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:02.007951 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 144/292] 10.222.0.40 () {56 vars in 1117 bytes} [Sun Oct 30 00:43:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 138 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:02.016289 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594e110-f1c4-4257-817b-3f1c97fdab6a admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:02.028822 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594e110-f1c4-4257-817b-3f1c97fdab6a admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:02.037803 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4618b83-cbba-481f-ae95-25578c0c52d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:02.038902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4618b83-cbba-481f-ae95-25578c0c52d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:02.038902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4618b83-cbba-481f-ae95-25578c0c52d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:02.038902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4618b83-cbba-481f-ae95-25578c0c52d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:02.041104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4618b83-cbba-481f-ae95-25578c0c52d6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:02.041104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4618b83-cbba-481f-ae95-25578c0c52d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:02.042378 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4618b83-cbba-481f-ae95-25578c0c52d6 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:02.054438 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 149/293] 10.222.0.40 () {56 vars in 1120 bytes} [Sun Oct 30 00:43:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:02.060391 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88bac4-3da8-441f-977c-e7736b4935ae admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:02.071455 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88bac4-3da8-441f-977c-e7736b4935ae admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:02.078252 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e1316-f759-4d06-8640-a285050b6722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:02.079138 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e1316-f759-4d06-8640-a285050b6722 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:02.079689 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e1316-f759-4d06-8640-a285050b6722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:02.080148 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e1316-f759-4d06-8640-a285050b6722 admin admin] PATH_INFO: `/v3/groups/3081d1b215af4e55b9bb94f02185103e` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:02.086031 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e1316-f759-4d06-8640-a285050b6722 admin admin] RBAC: Authorizing `identity:get_group(group_id=3081d1b215af4e55b9bb94f02185103e)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:02.088286 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e1316-f759-4d06-8640-a285050b6722 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:02.090229 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 145/294] 10.222.0.40 () {56 vars in 1201 bytes} [Sun Oct 30 00:43:02 2022] GET /identity/v3/groups/3081d1b215af4e55b9bb94f02185103e => generated 229 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:02.096146 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4618b83-cbba-481f-ae95-25578c0c52d6 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:02.107545 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4618b83-cbba-481f-ae95-25578c0c52d6 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:02.112377 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd435779-3f79-422b-a4e3-0f980ef54ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:02.113401 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd435779-3f79-422b-a4e3-0f980ef54ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:02.113887 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd435779-3f79-422b-a4e3-0f980ef54ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:02.114393 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd435779-3f79-422b-a4e3-0f980ef54ba5 admin admin] PATH_INFO: `/v3/projects/34e03b1d71cb423ba48cad74d0a6e7da` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:02.115756 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd435779-3f79-422b-a4e3-0f980ef54ba5 admin admin] RBAC: Authorizing `identity:get_project(project_id=34e03b1d71cb423ba48cad74d0a6e7da)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:02.117942 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd435779-3f79-422b-a4e3-0f980ef54ba5 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:02.119915 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 150/295] 10.222.0.40 () {56 vars in 1207 bytes} [Sun Oct 30 00:43:02 2022] GET /identity/v3/projects/34e03b1d71cb423ba48cad74d0a6e7da => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:02.125007 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3964ec-ca86-4259-9dbe-e319f0eb7997 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:02.125541 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3964ec-ca86-4259-9dbe-e319f0eb7997 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:02.126003 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3964ec-ca86-4259-9dbe-e319f0eb7997 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:02.127400 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd435779-3f79-422b-a4e3-0f980ef54ba5 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:02.127804 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 146/296] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:02.141306 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd435779-3f79-422b-a4e3-0f980ef54ba5 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:02.143979 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf6b2d-5215-4827-a6c9-7928a983461d None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:02.144463 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf6b2d-5215-4827-a6c9-7928a983461d None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:02.144925 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf6b2d-5215-4827-a6c9-7928a983461d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:02.146703 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1822f5-b8c6-4cda-8e48-516fc86f8585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:02.147354 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1822f5-b8c6-4cda-8e48-516fc86f8585 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:02.147631 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1822f5-b8c6-4cda-8e48-516fc86f8585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:02.147903 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1822f5-b8c6-4cda-8e48-516fc86f8585 admin admin] PATH_INFO: `/v3/projects/34e03b1d71cb423ba48cad74d0a6e7da/groups/3081d1b215af4e55b9bb94f02185103e/roles/17d0330d6df84d3091d7ef234dfc4e6b` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:02.154062 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1822f5-b8c6-4cda-8e48-516fc86f8585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34e03b1d71cb423ba48cad74d0a6e7da, group_id=3081d1b215af4e55b9bb94f02185103e, role_id=17d0330d6df84d3091d7ef234dfc4e6b)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:02.156738 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1822f5-b8c6-4cda-8e48-516fc86f8585 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:02.176623 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 151/297] 10.222.0.40 () {58 vars in 1463 bytes} [Sun Oct 30 00:43:02 2022] PUT /identity/v3/projects/34e03b1d71cb423ba48cad74d0a6e7da/groups/3081d1b215af4e55b9bb94f02185103e/roles/17d0330d6df84d3091d7ef234dfc4e6b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:43:02.177567 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-9bcf6b2d-5215-4827-a6c9-7928a983461d None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:02.178827 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9bcf6b2d-5215-4827-a6c9-7928a983461d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:02.262911 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 147/298] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:43:02.542195 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1822f5-b8c6-4cda-8e48-516fc86f8585 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:02.660312 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1822f5-b8c6-4cda-8e48-516fc86f8585 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:02.700964 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:02.706840 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163835f1-aa3b-479a-ac21-8a3127795baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:02.707835 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163835f1-aa3b-479a-ac21-8a3127795baa None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:02.708184 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163835f1-aa3b-479a-ac21-8a3127795baa None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:02.708513 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163835f1-aa3b-479a-ac21-8a3127795baa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:02.720785 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163835f1-aa3b-479a-ac21-8a3127795baa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:43:02.726021 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-163835f1-aa3b-479a-ac21-8a3127795baa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:43:02.726021 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:02.726021 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:02.726021 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:02.726021 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:02.726021 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:02.726021 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:02.726021 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:02.726021 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:02.726021 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:02.726021 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:02.726021 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:02.726021 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:43:02.726021 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:43:02.726021 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:43:02.726021 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:43:02.726918 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:43:02.726918 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:43:02.726918 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:43:02.726918 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:43:02.726918 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:02.726918 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:02.726918 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:02.726918 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:02.726918 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:02.726918 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:02.726918 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:02.726918 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:02.726918 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:02.726918 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:02.726918 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:02.726918 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:02.727733 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:02.727733 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:02.727733 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:02.727733 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:02.727733 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:43:02.727733 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:43:02.727733 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:43:02.727733 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:43:02.727733 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:43:02.727733 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:43:02.727733 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:43:02.727733 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:02.727733 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 152/299] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:43:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:02.733614 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf6b2d-5215-4827-a6c9-7928a983461d None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:02.760713 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb6610-0d9f-4c06-825d-d2926072f091 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:02.760974 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb6610-0d9f-4c06-825d-d2926072f091 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:02.761381 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb6610-0d9f-4c06-825d-d2926072f091 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:02.763793 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 153/300] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:43:02.769732 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956be9e-943f-4110-b7fe-688d2be7a440 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:02.770009 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956be9e-943f-4110-b7fe-688d2be7a440 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:02.770277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956be9e-943f-4110-b7fe-688d2be7a440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:02.795572 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-d956be9e-943f-4110-b7fe-688d2be7a440 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:02.797221 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d956be9e-943f-4110-b7fe-688d2be7a440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:02.826273 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:02.868663 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf6b2d-5215-4827-a6c9-7928a983461d None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:02.910368 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d94bc3-f4ca-4724-923e-b27b32e6feb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:02.911104 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d94bc3-f4ca-4724-923e-b27b32e6feb4 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:02.911378 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d94bc3-f4ca-4724-923e-b27b32e6feb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:02.911669 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d94bc3-f4ca-4724-923e-b27b32e6feb4 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:02.912406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d94bc3-f4ca-4724-923e-b27b32e6feb4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:02.912706 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d94bc3-f4ca-4724-923e-b27b32e6feb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:02.914171 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d94bc3-f4ca-4724-923e-b27b32e6feb4 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:02.923830 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 148/301] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Oct 30 00:43:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:02.929720 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d94bc3-f4ca-4724-923e-b27b32e6feb4 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:02.970851 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 154/302] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:43:03.059837 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d94bc3-f4ca-4724-923e-b27b32e6feb4 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:03.095962 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21893b0a-bbc2-42e4-b893-9d15c952e567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:03.096603 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21893b0a-bbc2-42e4-b893-9d15c952e567 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:03.096882 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21893b0a-bbc2-42e4-b893-9d15c952e567 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:03.097150 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21893b0a-bbc2-42e4-b893-9d15c952e567 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:03.113542 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:03.169604 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21893b0a-bbc2-42e4-b893-9d15c952e567 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:03.171094 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21893b0a-bbc2-42e4-b893-9d15c952e567 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:03.275318 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 149/303] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Oct 30 00:43:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 30 00:43:03.281097 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956be9e-943f-4110-b7fe-688d2be7a440 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:03.390288 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956be9e-943f-4110-b7fe-688d2be7a440 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:03.415508 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21893b0a-bbc2-42e4-b893-9d15c952e567 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:03.427538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:03.452368 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbba61-a43b-48b5-8b94-bf9a2bd9d726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:03.452999 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbba61-a43b-48b5-8b94-bf9a2bd9d726 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:03.453296 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbba61-a43b-48b5-8b94-bf9a2bd9d726 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:03.453561 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbba61-a43b-48b5-8b94-bf9a2bd9d726 None admin] PATH_INFO: `/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:03.455735 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbba61-a43b-48b5-8b94-bf9a2bd9d726 None admin] RBAC: Authorizing `identity:get_project(project_id=bbcd0ae183934d41a9caeb3d9450db6e)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:03.457150 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbba61-a43b-48b5-8b94-bf9a2bd9d726 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:03.463569 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 155/304] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Oct 30 00:43:03 2022] GET /identity/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:03.463763 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:03.471999 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbba61-a43b-48b5-8b94-bf9a2bd9d726 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:03.615058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbba61-a43b-48b5-8b94-bf9a2bd9d726 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:03.617611 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21893b0a-bbc2-42e4-b893-9d15c952e567 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:03.658115 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b548ea-b29c-4342-9b0f-6796928453f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:03.658664 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b548ea-b29c-4342-9b0f-6796928453f4 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:03.658940 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b548ea-b29c-4342-9b0f-6796928453f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:03.659209 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b548ea-b29c-4342-9b0f-6796928453f4 None admin] PATH_INFO: `/v3/groups/8fd4d47eec0847e4ad6b7862453dcf20` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:03.660505 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b548ea-b29c-4342-9b0f-6796928453f4 None admin] RBAC: Authorizing `identity:get_group(group_id=8fd4d47eec0847e4ad6b7862453dcf20)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:03.672758 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b548ea-b29c-4342-9b0f-6796928453f4 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:03.675468 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 156/305] 10.222.0.40 () {56 vars in 1180 bytes} [Sun Oct 30 00:43:03 2022] GET /identity/v3/groups/8fd4d47eec0847e4ad6b7862453dcf20 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:03.682269 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b548ea-b29c-4342-9b0f-6796928453f4 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:03.699563 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0ea79-51da-424d-8dda-3ab0813b4989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:03.700731 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0ea79-51da-424d-8dda-3ab0813b4989 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:03.701005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0ea79-51da-424d-8dda-3ab0813b4989 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:03.701325 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0ea79-51da-424d-8dda-3ab0813b4989 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:03.722144 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0ea79-51da-424d-8dda-3ab0813b4989 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:43:03.726961 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-d3f0ea79-51da-424d-8dda-3ab0813b4989 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:43:03.726961 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:03.726961 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:03.726961 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:03.726961 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:03.726961 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:03.726961 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:03.726961 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:03.726961 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:03.726961 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:03.726961 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:03.726961 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:03.726961 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:43:03.726961 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:43:03.726961 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:43:03.726961 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:43:03.727829 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:43:03.727829 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:43:03.727829 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:43:03.727829 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:43:03.727829 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:03.727829 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:03.727829 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:03.727829 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:03.727829 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:03.727829 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:03.727829 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:03.727829 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:03.727829 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:03.727829 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:03.727829 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:03.727829 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:03.728614 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:03.728614 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:03.728614 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:03.728614 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:03.728614 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:43:03.728614 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:43:03.728614 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:43:03.728614 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:43:03.728614 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:43:03.728614 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:43:03.728614 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:43:03.728614 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:03.728614 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 150/306] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Oct 30 00:43:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:03.736880 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0ea79-51da-424d-8dda-3ab0813b4989 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:03.784035 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:03.833377 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b548ea-b29c-4342-9b0f-6796928453f4 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:03.871373 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94427a7-a684-4e53-903f-bcb5484cb559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:03.872271 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94427a7-a684-4e53-903f-bcb5484cb559 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:03.872690 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94427a7-a684-4e53-903f-bcb5484cb559 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:03.873098 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94427a7-a684-4e53-903f-bcb5484cb559 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:03.873975 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94427a7-a684-4e53-903f-bcb5484cb559 None admin] RBAC: Adding query filter params (group.id=8fd4d47eec0847e4ad6b7862453dcf20, role.id=a2f2dde26304402eb433d8d8cfaca1e7, scope.project.id=bbcd0ae183934d41a9caeb3d9450db6e) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:03.874435 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94427a7-a684-4e53-903f-bcb5484cb559 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:03.876116 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94427a7-a684-4e53-903f-bcb5484cb559 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:03.882977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 157/307] 10.222.0.40 () {56 vars in 1376 bytes} [Sun Oct 30 00:43:03 2022] GET /identity/v3/role_assignments?group.id=8fd4d47eec0847e4ad6b7862453dcf20&scope.project.id=bbcd0ae183934d41a9caeb3d9450db6e&role.id=a2f2dde26304402eb433d8d8cfaca1e7 => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:03.889560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:03.909877 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0ea79-51da-424d-8dda-3ab0813b4989 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:03.959726 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fd8cb-2ff0-4641-971f-fc16b858b8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:03.960336 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fd8cb-2ff0-4641-971f-fc16b858b8ac None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:03.960609 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fd8cb-2ff0-4641-971f-fc16b858b8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:03.960875 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fd8cb-2ff0-4641-971f-fc16b858b8ac None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:03.961562 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fd8cb-2ff0-4641-971f-fc16b858b8ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:03.961869 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fd8cb-2ff0-4641-971f-fc16b858b8ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:03.963431 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fd8cb-2ff0-4641-971f-fc16b858b8ac None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:03.976657 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 151/308] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:43:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:03.982946 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94427a7-a684-4e53-903f-bcb5484cb559 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:04.115533 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94427a7-a684-4e53-903f-bcb5484cb559 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:04.141281 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:04.154851 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0bdc2-742b-43f8-a4b5-b0f0286ae352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:04.155455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0bdc2-742b-43f8-a4b5-b0f0286ae352 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:04.155728 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0bdc2-742b-43f8-a4b5-b0f0286ae352 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:04.155994 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0bdc2-742b-43f8-a4b5-b0f0286ae352 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:04.240471 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0bdc2-742b-43f8-a4b5-b0f0286ae352 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:04.241986 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0bdc2-742b-43f8-a4b5-b0f0286ae352 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:04.350987 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d878b-f00c-44f3-a0ba-c987fec30a8a None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:04.351265 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d878b-f00c-44f3-a0ba-c987fec30a8a None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:04.351541 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d878b-f00c-44f3-a0ba-c987fec30a8a None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:04.352575 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 158/309] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Oct 30 00:43:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:43:04.357541 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 152/310] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:43:04.358795 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0bdc2-742b-43f8-a4b5-b0f0286ae352 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:04.363346 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7da2e-0e33-4f4b-8597-5cb47c02d55a None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:04.363631 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7da2e-0e33-4f4b-8597-5cb47c02d55a None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:04.363903 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7da2e-0e33-4f4b-8597-5cb47c02d55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:04.383348 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:04.399657 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-8ae7da2e-0e33-4f4b-8597-5cb47c02d55a None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:04.400884 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8ae7da2e-0e33-4f4b-8597-5cb47c02d55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:04.472190 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0bdc2-742b-43f8-a4b5-b0f0286ae352 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:04.490557 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 153/311] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:43:04.509230 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8819348-9102-4c53-9da1-a26427ffc8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:04.509867 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8819348-9102-4c53-9da1-a26427ffc8d7 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:04.510143 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8819348-9102-4c53-9da1-a26427ffc8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:04.510413 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8819348-9102-4c53-9da1-a26427ffc8d7 None admin] PATH_INFO: `/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:04.511577 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8819348-9102-4c53-9da1-a26427ffc8d7 None admin] RBAC: Authorizing `identity:get_project(project_id=bbcd0ae183934d41a9caeb3d9450db6e)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:04.513619 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8819348-9102-4c53-9da1-a26427ffc8d7 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:04.515422 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 159/312] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Oct 30 00:43:04 2022] GET /identity/v3/projects/bbcd0ae183934d41a9caeb3d9450db6e => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:04.521018 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7da2e-0e33-4f4b-8597-5cb47c02d55a None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:04.603951 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:04.627131 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7da2e-0e33-4f4b-8597-5cb47c02d55a None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:04.664363 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492c022-f4de-4763-b5d1-68939d390da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:04.664363 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492c022-f4de-4763-b5d1-68939d390da9 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:04.664363 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492c022-f4de-4763-b5d1-68939d390da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:04.664363 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492c022-f4de-4763-b5d1-68939d390da9 None admin] PATH_INFO: `/v3/groups/8fd4d47eec0847e4ad6b7862453dcf20` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:04.665276 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492c022-f4de-4763-b5d1-68939d390da9 None admin] RBAC: Authorizing `identity:get_group(group_id=8fd4d47eec0847e4ad6b7862453dcf20)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:04.668148 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492c022-f4de-4763-b5d1-68939d390da9 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:04.668640 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 154/313] 10.222.0.40 () {56 vars in 1180 bytes} [Sun Oct 30 00:43:04 2022] GET /identity/v3/groups/8fd4d47eec0847e4ad6b7862453dcf20 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:04.674348 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8819348-9102-4c53-9da1-a26427ffc8d7 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:04.782315 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:04.795367 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8819348-9102-4c53-9da1-a26427ffc8d7 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:04.825259 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492c022-f4de-4763-b5d1-68939d390da9 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:04.844991 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d00978-bec2-4ac6-bab7-1370c206d4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:04.845654 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d00978-bec2-4ac6-bab7-1370c206d4e4 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:04.845934 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d00978-bec2-4ac6-bab7-1370c206d4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:04.846245 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d00978-bec2-4ac6-bab7-1370c206d4e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:04.846986 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d00978-bec2-4ac6-bab7-1370c206d4e4 None admin] RBAC: Adding query filter params (group.id=8fd4d47eec0847e4ad6b7862453dcf20, role.id=b63857cb2ff04d189523309091368e81, scope.project.id=bbcd0ae183934d41a9caeb3d9450db6e) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:04.847292 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d00978-bec2-4ac6-bab7-1370c206d4e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:04.848726 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d00978-bec2-4ac6-bab7-1370c206d4e4 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:04.856944 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 160/314] 10.222.0.40 () {56 vars in 1376 bytes} [Sun Oct 30 00:43:04 2022] GET /identity/v3/role_assignments?group.id=8fd4d47eec0847e4ad6b7862453dcf20&scope.project.id=bbcd0ae183934d41a9caeb3d9450db6e&role.id=b63857cb2ff04d189523309091368e81 => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:04.858481 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f86735-ee87-4f21-b6ab-f8bfbe6e3092 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:04.858762 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f86735-ee87-4f21-b6ab-f8bfbe6e3092 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:04.859032 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f86735-ee87-4f21-b6ab-f8bfbe6e3092 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:04.862467 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 161/315] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:04.868317 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551145ce-80ca-41cd-a8b0-a53d9c8cdbf7 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:04.868593 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551145ce-80ca-41cd-a8b0-a53d9c8cdbf7 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:04.868920 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551145ce-80ca-41cd-a8b0-a53d9c8cdbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:04.906308 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-551145ce-80ca-41cd-a8b0-a53d9c8cdbf7 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:04.907521 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-551145ce-80ca-41cd-a8b0-a53d9c8cdbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:04.958026 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492c022-f4de-4763-b5d1-68939d390da9 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:04.999443 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd60f49-15ba-4203-b187-104efc8a7b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:05.000333 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd60f49-15ba-4203-b187-104efc8a7b4c None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:05.000737 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd60f49-15ba-4203-b187-104efc8a7b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:05.001127 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd60f49-15ba-4203-b187-104efc8a7b4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:05.014305 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 162/316] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:43:05.015180 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd60f49-15ba-4203-b187-104efc8a7b4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:43:05.020368 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-1fd60f49-15ba-4203-b187-104efc8a7b4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:43:05.020368 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:05.020368 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:05.020368 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:05.020368 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:05.020368 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:05.020368 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:05.020368 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:05.020368 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:05.020368 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:05.020368 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:05.020368 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:05.020368 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:43:05.020368 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:43:05.020368 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:43:05.020368 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:43:05.021344 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:43:05.021344 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:43:05.021344 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:43:05.021344 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:43:05.021344 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:05.021344 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:05.021344 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:05.021344 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:05.021344 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:05.021344 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:05.021344 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:05.021344 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:05.021344 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:05.021344 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:05.021344 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:05.021344 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:05.022153 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:05.022153 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:05.022153 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:05.022153 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:05.022153 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:43:05.022153 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:43:05.022153 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:43:05.022153 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:43:05.022153 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:43:05.022153 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:43:05.022153 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:43:05.022153 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:05.025149 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 155/317] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:43:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:43:05.030972 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551145ce-80ca-41cd-a8b0-a53d9c8cdbf7 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:05.138243 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:05.163766 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551145ce-80ca-41cd-a8b0-a53d9c8cdbf7 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:05.205421 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca8b20-8eef-41fb-8ecf-5d2d162cc064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:05.206032 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca8b20-8eef-41fb-8ecf-5d2d162cc064 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:05.206309 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca8b20-8eef-41fb-8ecf-5d2d162cc064 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:05.206580 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca8b20-8eef-41fb-8ecf-5d2d162cc064 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:05.207237 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca8b20-8eef-41fb-8ecf-5d2d162cc064 None admin] RBAC: Adding query filter params (name=member) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:05.207538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca8b20-8eef-41fb-8ecf-5d2d162cc064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:05.208912 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca8b20-8eef-41fb-8ecf-5d2d162cc064 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:05.220742 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 163/318] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Oct 30 00:43:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:05.226489 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd60f49-15ba-4203-b187-104efc8a7b4c None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:05.235974 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:05.280121 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275219a5-99ea-4e73-9622-cf567fa5911c None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:05.280430 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275219a5-99ea-4e73-9622-cf567fa5911c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:05.280683 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275219a5-99ea-4e73-9622-cf567fa5911c None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:05.282322 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 164/319] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:05.287360 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8072d9-9454-497d-b117-52978d7d49b7 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:05.287640 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8072d9-9454-497d-b117-52978d7d49b7 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:05.287913 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8072d9-9454-497d-b117-52978d7d49b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:05.310330 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-ae8072d9-9454-497d-b117-52978d7d49b7 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:05.311508 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ae8072d9-9454-497d-b117-52978d7d49b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:05.342112 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd60f49-15ba-4203-b187-104efc8a7b4c None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:05.384441 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c321f22-1732-4ae3-b15f-8e3b008d229e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:05.385322 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c321f22-1732-4ae3-b15f-8e3b008d229e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:05.385592 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c321f22-1732-4ae3-b15f-8e3b008d229e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:05.385850 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c321f22-1732-4ae3-b15f-8e3b008d229e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:05.386796 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 165/320] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:43:05.387654 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8072d9-9454-497d-b117-52978d7d49b7 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:05.484940 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c321f22-1732-4ae3-b15f-8e3b008d229e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:05.486803 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c321f22-1732-4ae3-b15f-8e3b008d229e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:05.487454 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:05.496541 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:05.517249 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8072d9-9454-497d-b117-52978d7d49b7 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:05.559613 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441d3ac-d57a-4727-8022-f899db1cad0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:05.560239 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441d3ac-d57a-4727-8022-f899db1cad0d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:05.560517 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441d3ac-d57a-4727-8022-f899db1cad0d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:05.560794 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441d3ac-d57a-4727-8022-f899db1cad0d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:05.576816 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441d3ac-d57a-4727-8022-f899db1cad0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:43:05.581938 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-3441d3ac-d57a-4727-8022-f899db1cad0d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:43:05.581938 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:05.581938 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:05.581938 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:05.581938 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:05.581938 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:05.581938 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:05.581938 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:05.581938 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:05.581938 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:05.581938 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:05.581938 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:05.581938 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:43:05.581938 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:43:05.581938 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:43:05.581938 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:43:05.582970 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:43:05.582970 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:43:05.582970 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:43:05.582970 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:43:05.582970 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:05.582970 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:05.582970 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:05.582970 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:05.582970 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:05.582970 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:05.582970 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:05.582970 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:05.582970 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:05.582970 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:05.582970 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:05.582970 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:05.583995 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:05.583995 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:05.583995 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:05.583995 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:05.583995 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:43:05.583995 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:43:05.583995 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:43:05.583995 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:43:05.583995 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:43:05.583995 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:43:05.583995 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:43:05.583995 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:05.586595 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 166/321] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Oct 30 00:43:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:05.595205 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441d3ac-d57a-4727-8022-f899db1cad0d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:05.618325 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 156/322] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Oct 30 00:43:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:43:05.624584 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c321f22-1732-4ae3-b15f-8e3b008d229e None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:05.727523 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441d3ac-d57a-4727-8022-f899db1cad0d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:05.754314 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c321f22-1732-4ae3-b15f-8e3b008d229e None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:05.764014 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:05.771704 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdc958-2957-452b-a8b1-588c30b923b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:05.772305 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdc958-2957-452b-a8b1-588c30b923b6 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:05.772577 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdc958-2957-452b-a8b1-588c30b923b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:05.772842 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdc958-2957-452b-a8b1-588c30b923b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:05.773524 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbdc958-2957-452b-a8b1-588c30b923b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:05.774086 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbdc958-2957-452b-a8b1-588c30b923b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:05.775455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbdc958-2957-452b-a8b1-588c30b923b6 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:05.777853 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:05.785429 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 167/323] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:43:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:43:05.786093 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdc958-2957-452b-a8b1-588c30b923b6 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:05.796983 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b0338-6c81-4f76-827b-58230c588f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:05.799147 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b0338-6c81-4f76-827b-58230c588f56 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:05.799147 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b0338-6c81-4f76-827b-58230c588f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:05.799147 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b0338-6c81-4f76-827b-58230c588f56 None admin] PATH_INFO: `/v3/projects/88c423a2de7d46ff97e231261ac80890` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:05.799371 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b0338-6c81-4f76-827b-58230c588f56 None admin] RBAC: Authorizing `identity:get_project(project_id=88c423a2de7d46ff97e231261ac80890)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:05.801235 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b0338-6c81-4f76-827b-58230c588f56 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:05.802415 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 157/324] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Oct 30 00:43:05 2022] GET /identity/v3/projects/88c423a2de7d46ff97e231261ac80890 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:43:05.805372 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b0338-6c81-4f76-827b-58230c588f56 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:05.915724 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b0338-6c81-4f76-827b-58230c588f56 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:05.916313 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdc958-2957-452b-a8b1-588c30b923b6 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:05.957828 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df395a-d1ed-47d7-adb9-f1d5da4c9cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:05.958457 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df395a-d1ed-47d7-adb9-f1d5da4c9cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:05.958729 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df395a-d1ed-47d7-adb9-f1d5da4c9cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:05.958827 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd6d69-eef4-4e9a-9b42-dd717d86e765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:05.959008 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df395a-d1ed-47d7-adb9-f1d5da4c9cd2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:05.959383 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd6d69-eef4-4e9a-9b42-dd717d86e765 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:05.959656 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd6d69-eef4-4e9a-9b42-dd717d86e765 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:05.959921 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd6d69-eef4-4e9a-9b42-dd717d86e765 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:05.972534 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df395a-d1ed-47d7-adb9-f1d5da4c9cd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:43:05.979282 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-01df395a-d1ed-47d7-adb9-f1d5da4c9cd2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:43:05.979282 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:05.979282 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:05.979282 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:05.979282 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:05.979282 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:05.979282 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:05.979282 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:05.979282 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:05.979282 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:05.979282 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:05.979282 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:05.979282 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:43:05.979282 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:43:05.979282 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:43:05.979282 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:43:05.980200 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:43:05.980200 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:43:05.980200 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:43:05.980200 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:43:05.980200 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:05.980200 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:05.980200 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:05.980200 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:05.980200 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:05.980200 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:05.980200 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:05.980200 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:05.980200 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:05.980200 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:05.980200 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:05.980200 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:05.981075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:05.981075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:05.981075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:05.981075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:05.981075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:43:05.981075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:43:05.981075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:43:05.981075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:43:05.981075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:43:05.981075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:43:05.981075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:43:05.981075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:05.981075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 168/325] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Oct 30 00:43:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:05.981815 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df395a-d1ed-47d7-adb9-f1d5da4c9cd2 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:06.011250 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:06.040089 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd6d69-eef4-4e9a-9b42-dd717d86e765 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:06.041575 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd6d69-eef4-4e9a-9b42-dd717d86e765 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:06.052591 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:06.103471 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df395a-d1ed-47d7-adb9-f1d5da4c9cd2 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:06.141870 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7e6c8-b9fd-483a-ab55-a3637c23b616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:06.142499 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7e6c8-b9fd-483a-ab55-a3637c23b616 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:06.142783 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7e6c8-b9fd-483a-ab55-a3637c23b616 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:06.143051 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7e6c8-b9fd-483a-ab55-a3637c23b616 None admin] PATH_INFO: `/v3/groups/8fd4d47eec0847e4ad6b7862453dcf20` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:06.144224 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7e6c8-b9fd-483a-ab55-a3637c23b616 None admin] RBAC: Authorizing `identity:get_group(group_id=8fd4d47eec0847e4ad6b7862453dcf20)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:06.145796 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7e6c8-b9fd-483a-ab55-a3637c23b616 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:06.147361 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 169/326] 10.222.0.40 () {56 vars in 1180 bytes} [Sun Oct 30 00:43:05 2022] GET /identity/v3/groups/8fd4d47eec0847e4ad6b7862453dcf20 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:06.148110 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7e6c8-b9fd-483a-ab55-a3637c23b616 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:06.167913 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 158/327] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Oct 30 00:43:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:43:06.170176 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd6d69-eef4-4e9a-9b42-dd717d86e765 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:06.255457 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:06.264551 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7e6c8-b9fd-483a-ab55-a3637c23b616 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:06.286899 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd6d69-eef4-4e9a-9b42-dd717d86e765 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:06.295923 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:06.304601 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b7620-0c75-498b-893f-337ee943ecc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:06.305223 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b7620-0c75-498b-893f-337ee943ecc2 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:06.305487 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b7620-0c75-498b-893f-337ee943ecc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:06.305752 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b7620-0c75-498b-893f-337ee943ecc2 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:06.306396 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b7620-0c75-498b-893f-337ee943ecc2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:06.306702 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b7620-0c75-498b-893f-337ee943ecc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:06.308032 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b7620-0c75-498b-893f-337ee943ecc2 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:06.316464 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 170/328] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:43:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:06.317280 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b7620-0c75-498b-893f-337ee943ecc2 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:06.326170 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e486ba5-494c-4c35-a06a-02e4af059a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:06.326764 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e486ba5-494c-4c35-a06a-02e4af059a0a None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:06.327039 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e486ba5-494c-4c35-a06a-02e4af059a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:06.327314 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e486ba5-494c-4c35-a06a-02e4af059a0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:06.328030 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e486ba5-494c-4c35-a06a-02e4af059a0a None admin] RBAC: Adding query filter params (group.id=8fd4d47eec0847e4ad6b7862453dcf20, role.id=a2f2dde26304402eb433d8d8cfaca1e7, scope.project.id=88c423a2de7d46ff97e231261ac80890) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:06.328328 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e486ba5-494c-4c35-a06a-02e4af059a0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:06.329786 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e486ba5-494c-4c35-a06a-02e4af059a0a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:06.335492 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 159/329] 10.222.0.40 () {56 vars in 1376 bytes} [Sun Oct 30 00:43:06 2022] GET /identity/v3/role_assignments?group.id=8fd4d47eec0847e4ad6b7862453dcf20&scope.project.id=88c423a2de7d46ff97e231261ac80890&role.id=a2f2dde26304402eb433d8d8cfaca1e7 => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:06.336188 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e486ba5-494c-4c35-a06a-02e4af059a0a None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:06.427380 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b7620-0c75-498b-893f-337ee943ecc2 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:06.455245 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e486ba5-494c-4c35-a06a-02e4af059a0a None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:06.463924 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0bee3-94fb-4476-ad08-2dfd19b674d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:06.464820 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0bee3-94fb-4476-ad08-2dfd19b674d4 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:06.465843 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0bee3-94fb-4476-ad08-2dfd19b674d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:06.466126 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0bee3-94fb-4476-ad08-2dfd19b674d4 None admin] PATH_INFO: `/v3/projects/88c423a2de7d46ff97e231261ac80890` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:06.467323 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0bee3-94fb-4476-ad08-2dfd19b674d4 None admin] RBAC: Authorizing `identity:get_project(project_id=88c423a2de7d46ff97e231261ac80890)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:06.468782 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0bee3-94fb-4476-ad08-2dfd19b674d4 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:06.470661 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 171/330] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Oct 30 00:43:06 2022] GET /identity/v3/projects/88c423a2de7d46ff97e231261ac80890 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:06.476170 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0bee3-94fb-4476-ad08-2dfd19b674d4 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:06.492627 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eeed90-ef7d-418d-80a5-dc31fe09c169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:06.493263 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eeed90-ef7d-418d-80a5-dc31fe09c169 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:06.493548 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eeed90-ef7d-418d-80a5-dc31fe09c169 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:06.493808 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eeed90-ef7d-418d-80a5-dc31fe09c169 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:06.502970 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:06.546164 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:06.574476 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eeed90-ef7d-418d-80a5-dc31fe09c169 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:06.576480 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eeed90-ef7d-418d-80a5-dc31fe09c169 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:06.602581 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0bee3-94fb-4476-ad08-2dfd19b674d4 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:06.642593 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c61767-185b-4336-bfcc-178eb98bb5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:06.643232 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c61767-185b-4336-bfcc-178eb98bb5ff None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:06.643510 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c61767-185b-4336-bfcc-178eb98bb5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:06.643784 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c61767-185b-4336-bfcc-178eb98bb5ff None admin] PATH_INFO: `/v3/groups/8fd4d47eec0847e4ad6b7862453dcf20` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:06.644887 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c61767-185b-4336-bfcc-178eb98bb5ff None admin] RBAC: Authorizing `identity:get_group(group_id=8fd4d47eec0847e4ad6b7862453dcf20)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:06.646530 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c61767-185b-4336-bfcc-178eb98bb5ff None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:06.649329 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 172/331] 10.222.0.40 () {56 vars in 1180 bytes} [Sun Oct 30 00:43:06 2022] GET /identity/v3/groups/8fd4d47eec0847e4ad6b7862453dcf20 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:43:06.658682 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c61767-185b-4336-bfcc-178eb98bb5ff None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:06.696582 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 160/332] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Oct 30 00:43:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:43:06.702653 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eeed90-ef7d-418d-80a5-dc31fe09c169 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:06.741671 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:06.770469 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c61767-185b-4336-bfcc-178eb98bb5ff None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:06.794048 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:06.803473 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eeed90-ef7d-418d-80a5-dc31fe09c169 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:06.804525 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72077e-0029-4730-92a1-6c25dd67b9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:06.805116 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72077e-0029-4730-92a1-6c25dd67b9ef None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:06.805419 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72077e-0029-4730-92a1-6c25dd67b9ef None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:06.805692 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72077e-0029-4730-92a1-6c25dd67b9ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:06.806399 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72077e-0029-4730-92a1-6c25dd67b9ef None admin] RBAC: Adding query filter params (group.id=8fd4d47eec0847e4ad6b7862453dcf20, role.id=b63857cb2ff04d189523309091368e81, scope.project.id=88c423a2de7d46ff97e231261ac80890) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:06.806700 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72077e-0029-4730-92a1-6c25dd67b9ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:06.808113 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72077e-0029-4730-92a1-6c25dd67b9ef None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:06.814148 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 173/333] 10.222.0.40 () {56 vars in 1376 bytes} [Sun Oct 30 00:43:06 2022] GET /identity/v3/role_assignments?group.id=8fd4d47eec0847e4ad6b7862453dcf20&scope.project.id=88c423a2de7d46ff97e231261ac80890&role.id=b63857cb2ff04d189523309091368e81 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:06.838749 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c1af1-f167-4e7b-abe8-ae0519195932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:06.839394 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c1af1-f167-4e7b-abe8-ae0519195932 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:06.839670 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c1af1-f167-4e7b-abe8-ae0519195932 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:06.839943 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c1af1-f167-4e7b-abe8-ae0519195932 None admin] PATH_INFO: `/v3/projects/34e03b1d71cb423ba48cad74d0a6e7da` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:06.841173 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c1af1-f167-4e7b-abe8-ae0519195932 None admin] RBAC: Authorizing `identity:get_project(project_id=34e03b1d71cb423ba48cad74d0a6e7da)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:06.842701 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c1af1-f167-4e7b-abe8-ae0519195932 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:06.844409 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 161/334] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Oct 30 00:43:06 2022] GET /identity/v3/projects/34e03b1d71cb423ba48cad74d0a6e7da => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:43:06.850205 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72077e-0029-4730-92a1-6c25dd67b9ef None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:06.955927 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72077e-0029-4730-92a1-6c25dd67b9ef None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:06.989467 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a4395-4d47-433b-9129-940e912dea40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:06.990089 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a4395-4d47-433b-9129-940e912dea40 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:06.990361 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a4395-4d47-433b-9129-940e912dea40 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:06.990626 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a4395-4d47-433b-9129-940e912dea40 None admin] PATH_INFO: `/v3/groups/3081d1b215af4e55b9bb94f02185103e` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:06.991702 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a4395-4d47-433b-9129-940e912dea40 None admin] RBAC: Authorizing `identity:get_group(group_id=3081d1b215af4e55b9bb94f02185103e)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:06.993118 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a4395-4d47-433b-9129-940e912dea40 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:06.994693 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 174/335] 10.222.0.40 () {56 vars in 1180 bytes} [Sun Oct 30 00:43:06 2022] GET /identity/v3/groups/3081d1b215af4e55b9bb94f02185103e => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:07.001221 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c1af1-f167-4e7b-abe8-ae0519195932 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:07.103488 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c1af1-f167-4e7b-abe8-ae0519195932 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:07.111338 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:07.139992 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3102d55-e848-4c16-8e7b-7ffc40b09fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:07.140589 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3102d55-e848-4c16-8e7b-7ffc40b09fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:07.140867 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3102d55-e848-4c16-8e7b-7ffc40b09fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:07.141138 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3102d55-e848-4c16-8e7b-7ffc40b09fa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:07.141885 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3102d55-e848-4c16-8e7b-7ffc40b09fa0 None admin] RBAC: Adding query filter params (group.id=3081d1b215af4e55b9bb94f02185103e, role.id=17d0330d6df84d3091d7ef234dfc4e6b, scope.project.id=34e03b1d71cb423ba48cad74d0a6e7da) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:07.142191 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3102d55-e848-4c16-8e7b-7ffc40b09fa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:07.143611 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3102d55-e848-4c16-8e7b-7ffc40b09fa0 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:07.149700 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 162/336] 10.222.0.40 () {56 vars in 1376 bytes} [Sun Oct 30 00:43:07 2022] GET /identity/v3/role_assignments?group.id=3081d1b215af4e55b9bb94f02185103e&scope.project.id=34e03b1d71cb423ba48cad74d0a6e7da&role.id=17d0330d6df84d3091d7ef234dfc4e6b => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:09.679856 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bd9b0-3b1d-4f97-9760-be58640037a8 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:09.680468 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bd9b0-3b1d-4f97-9760-be58640037a8 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:09.680468 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bd9b0-3b1d-4f97-9760-be58640037a8 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:09.682156 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 175/337] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:09.687674 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12776a-f10e-4b56-9f12-104e61cc631a None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:09.688182 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12776a-f10e-4b56-9f12-104e61cc631a None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:09.688352 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12776a-f10e-4b56-9f12-104e61cc631a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:09.722189 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-0f12776a-f10e-4b56-9f12-104e61cc631a None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:09.723708 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-0f12776a-f10e-4b56-9f12-104e61cc631a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:09.807846 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 163/338] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:43:09.808388 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2207b3-7c4c-4ddc-85c1-b5194225380d None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:09.808678 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2207b3-7c4c-4ddc-85c1-b5194225380d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:09.809522 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2207b3-7c4c-4ddc-85c1-b5194225380d None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:09.811184 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 176/339] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:09.816090 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17ee99-2d41-47d8-967e-97175767e589 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:09.816589 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17ee99-2d41-47d8-967e-97175767e589 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:09.817067 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17ee99-2d41-47d8-967e-97175767e589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:09.840207 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-fe17ee99-2d41-47d8-967e-97175767e589 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:09.841706 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-fe17ee99-2d41-47d8-967e-97175767e589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:09.931549 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 164/340] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:43:10.110669 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2207b3-7c4c-4ddc-85c1-b5194225380d None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:10.190264 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:10.255095 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2207b3-7c4c-4ddc-85c1-b5194225380d None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:10.303184 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd17cfd-e3c0-4cf9-b66e-0c2ecc4fc86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:10.304171 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd17cfd-e3c0-4cf9-b66e-0c2ecc4fc86f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:10.304650 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd17cfd-e3c0-4cf9-b66e-0c2ecc4fc86f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:10.305140 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd17cfd-e3c0-4cf9-b66e-0c2ecc4fc86f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:10.320809 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd17cfd-e3c0-4cf9-b66e-0c2ecc4fc86f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:10.322543 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd17cfd-e3c0-4cf9-b66e-0c2ecc4fc86f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:10.341358 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-3dd17cfd-e3c0-4cf9-b66e-0c2ecc4fc86f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:10.341358 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:10.341358 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:10.341358 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:10.341358 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:10.341358 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:10.341358 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:10.341358 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:10.341358 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:10.341358 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:10.341358 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:10.341358 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:10.341358 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:10.341358 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:10.341358 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:10.341358 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:10.342321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:10.342321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:10.342321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:10.342321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:10.342321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:10.342321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:10.342321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:10.342321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:10.342321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:10.342321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:10.342321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:10.342321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:10.342321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:10.342321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:10.342321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:10.342321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:10.342321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:10.343168 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:10.343168 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:10.343168 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:10.345305 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 177/341] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:10.351229 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17ee99-2d41-47d8-967e-97175767e589 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:10.388398 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0325107-550e-47c4-b667-bce0eb1b188e None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:10.389005 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0325107-550e-47c4-b667-bce0eb1b188e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:10.389517 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0325107-550e-47c4-b667-bce0eb1b188e None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:10.391285 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 178/342] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:10.398443 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46806f-2fd3-4499-8d22-4ec93189abbc None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:10.399242 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46806f-2fd3-4499-8d22-4ec93189abbc None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:10.399735 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46806f-2fd3-4499-8d22-4ec93189abbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:10.413563 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:10.438319 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-0f46806f-2fd3-4499-8d22-4ec93189abbc None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:10.439553 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0f46806f-2fd3-4499-8d22-4ec93189abbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:10.499109 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17ee99-2d41-47d8-967e-97175767e589 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:10.518808 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 179/343] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:43:10.525651 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46806f-2fd3-4499-8d22-4ec93189abbc None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:10.546715 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69a279-0389-4791-b9e3-c292170539b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:10.547315 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69a279-0389-4791-b9e3-c292170539b8 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:10.547588 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69a279-0389-4791-b9e3-c292170539b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:10.547856 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69a279-0389-4791-b9e3-c292170539b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:10.548490 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69a279-0389-4791-b9e3-c292170539b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:10.548787 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69a279-0389-4791-b9e3-c292170539b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:10.550284 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69a279-0389-4791-b9e3-c292170539b8 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:10.562786 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 165/344] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:10.564399 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10a340-4dc7-4812-b5d4-03c8c265e74b None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:10.564816 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10a340-4dc7-4812-b5d4-03c8c265e74b None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:10.565244 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10a340-4dc7-4812-b5d4-03c8c265e74b None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:10.566629 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 166/345] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:10.571940 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10a340-4dc7-4812-b5d4-03c8c265e74b None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:10.577526 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:10.642278 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46806f-2fd3-4499-8d22-4ec93189abbc None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:10.688694 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:10.696179 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab527d-a2b3-4577-b3df-114085205d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:10.697213 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab527d-a2b3-4577-b3df-114085205d58 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:10.697594 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab527d-a2b3-4577-b3df-114085205d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:10.697964 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab527d-a2b3-4577-b3df-114085205d58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:10.702476 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10a340-4dc7-4812-b5d4-03c8c265e74b None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:10.710879 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab527d-a2b3-4577-b3df-114085205d58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:10.713082 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab527d-a2b3-4577-b3df-114085205d58 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:10.735205 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-68ab527d-a2b3-4577-b3df-114085205d58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:10.735205 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:10.735205 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:10.735205 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:10.735205 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:10.735205 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:10.735205 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:10.735205 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:10.735205 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:10.735205 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:10.735205 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:10.735205 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:10.735205 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:10.735205 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:10.735205 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:10.735205 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:10.736299 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:10.736299 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:10.736299 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:10.736299 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:10.736299 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:10.736299 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:10.736299 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:10.736299 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:10.736299 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:10.736299 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:10.736299 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:10.736299 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:10.736299 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:10.736299 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:10.736299 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:10.736299 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:10.736299 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:10.737425 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:10.737425 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:10.737425 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:10.738841 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 180/346] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:10.740749 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24f6a9-b426-427a-9164-63205a1b0b92 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:10.741442 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24f6a9-b426-427a-9164-63205a1b0b92 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:10.741797 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24f6a9-b426-427a-9164-63205a1b0b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:10.745746 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c51e50-7022-498c-bf86-aae80cfeab0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:10.746544 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c51e50-7022-498c-bf86-aae80cfeab0b None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:10.747030 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c51e50-7022-498c-bf86-aae80cfeab0b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:10.747580 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c51e50-7022-498c-bf86-aae80cfeab0b None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:10.748860 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c51e50-7022-498c-bf86-aae80cfeab0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:10.751410 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c51e50-7022-498c-bf86-aae80cfeab0b None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:10.762554 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-dc24f6a9-b426-427a-9164-63205a1b0b92 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:10.764143 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-dc24f6a9-b426-427a-9164-63205a1b0b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:10.776657 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 167/347] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Oct 30 00:43:10 2022] POST /identity/v3/users => generated 246 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:43:10.777584 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c51e50-7022-498c-bf86-aae80cfeab0b None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:10.863912 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 181/348] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:43:10.880870 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24f6a9-b426-427a-9164-63205a1b0b92 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:10.908100 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c51e50-7022-498c-bf86-aae80cfeab0b None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:10.928701 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:10.980541 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc511b-f210-4829-b945-bd67f12cebd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:10.981727 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc511b-f210-4829-b945-bd67f12cebd3 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:10.982004 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc511b-f210-4829-b945-bd67f12cebd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:10.982280 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc511b-f210-4829-b945-bd67f12cebd3 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:10.982935 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc511b-f210-4829-b945-bd67f12cebd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:10.983238 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc511b-f210-4829-b945-bd67f12cebd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:10.984629 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc511b-f210-4829-b945-bd67f12cebd3 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:11.010381 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 168/349] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:11.015804 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc511b-f210-4829-b945-bd67f12cebd3 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:11.026691 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:11.059055 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24f6a9-b426-427a-9164-63205a1b0b92 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:11.110783 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff264fe-ff1b-4e50-8e8f-a3b52ab6bcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:11.111413 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff264fe-ff1b-4e50-8e8f-a3b52ab6bcb8 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:11.111692 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff264fe-ff1b-4e50-8e8f-a3b52ab6bcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:11.111983 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff264fe-ff1b-4e50-8e8f-a3b52ab6bcb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:11.122919 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff264fe-ff1b-4e50-8e8f-a3b52ab6bcb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:11.124534 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff264fe-ff1b-4e50-8e8f-a3b52ab6bcb8 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:11.140238 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-bff264fe-ff1b-4e50-8e8f-a3b52ab6bcb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:11.140238 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:11.140238 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:11.140238 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:11.140238 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:11.140238 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:11.140238 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:11.140238 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:11.140238 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:11.140238 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:11.140238 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:11.140238 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:11.140238 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:11.140238 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:11.140238 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:11.140238 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:11.141173 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:11.141173 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:11.141173 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:11.141173 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:11.141173 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:11.141173 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:11.141173 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:11.141173 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:11.141173 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:11.141173 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:11.141173 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:11.141173 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:11.141173 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:11.141173 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:11.141173 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:11.141173 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:11.141173 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:11.142730 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:11.142730 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:11.142730 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:11.142730 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 182/350] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:43:11.147560 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff264fe-ff1b-4e50-8e8f-a3b52ab6bcb8 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:11.181066 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc511b-f210-4829-b945-bd67f12cebd3 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:11.226334 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:11.244409 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d2bbb-afc1-48de-b7c2-440e047b7fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:11.245477 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d2bbb-afc1-48de-b7c2-440e047b7fc6 None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:11.245947 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d2bbb-afc1-48de-b7c2-440e047b7fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:11.246985 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d2bbb-afc1-48de-b7c2-440e047b7fc6 None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:11.247970 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d2bbb-afc1-48de-b7c2-440e047b7fc6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:11.249654 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d2bbb-afc1-48de-b7c2-440e047b7fc6 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:11.259832 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff264fe-ff1b-4e50-8e8f-a3b52ab6bcb8 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:11.278490 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 169/351] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Oct 30 00:43:11 2022] POST /identity/v3/users => generated 248 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:43:11.279786 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d2bbb-afc1-48de-b7c2-440e047b7fc6 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:11.313835 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f715e1-afa3-4ef1-a1b9-a20fb7ff50c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:11.314484 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f715e1-afa3-4ef1-a1b9-a20fb7ff50c6 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:11.314755 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f715e1-afa3-4ef1-a1b9-a20fb7ff50c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:11.315027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f715e1-afa3-4ef1-a1b9-a20fb7ff50c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:11.315808 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f715e1-afa3-4ef1-a1b9-a20fb7ff50c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:11.316018 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f715e1-afa3-4ef1-a1b9-a20fb7ff50c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:11.317476 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f715e1-afa3-4ef1-a1b9-a20fb7ff50c6 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:11.350908 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 183/352] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:11.352234 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1a7a3-5568-4e1c-afe3-e8ef3e6477fe None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:11.352514 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1a7a3-5568-4e1c-afe3-e8ef3e6477fe None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:11.352781 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1a7a3-5568-4e1c-afe3-e8ef3e6477fe None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:11.354053 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 184/353] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:11.357716 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:11.358943 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1a7a3-5568-4e1c-afe3-e8ef3e6477fe None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:11.408568 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d2bbb-afc1-48de-b7c2-440e047b7fc6 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:11.448399 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13224eea-7e05-4f22-bc97-0d653509b17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:11.449540 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13224eea-7e05-4f22-bc97-0d653509b17e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:11.450016 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13224eea-7e05-4f22-bc97-0d653509b17e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:11.450479 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13224eea-7e05-4f22-bc97-0d653509b17e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:11.463766 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13224eea-7e05-4f22-bc97-0d653509b17e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:11.466367 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13224eea-7e05-4f22-bc97-0d653509b17e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:11.484385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-13224eea-7e05-4f22-bc97-0d653509b17e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:11.484385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:11.484385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:11.484385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:11.484385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:11.484385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:11.484385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:11.484385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:11.484385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:11.484385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:11.484385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:11.484385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:11.484385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:11.484385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:11.484385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:11.484385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:11.485349 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:11.485349 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:11.485349 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:11.485349 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:11.485349 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:11.485349 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:11.485349 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:11.485349 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:11.485349 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:11.485349 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:11.485349 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:11.485349 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:11.485349 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:11.485349 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:11.485349 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:11.485349 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:11.485349 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:11.486204 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:11.486204 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:11.486204 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:11.488144 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 170/354] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:11.489021 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1a7a3-5568-4e1c-afe3-e8ef3e6477fe None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:11.489948 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a481c-0aae-4440-be34-f8d844e7d283 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:11.490422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a481c-0aae-4440-be34-f8d844e7d283 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:11.490936 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a481c-0aae-4440-be34-f8d844e7d283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:11.511871 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-843a481c-0aae-4440-be34-f8d844e7d283 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:11.513551 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-843a481c-0aae-4440-be34-f8d844e7d283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:11.526725 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:11.533178 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f525f-2940-42d9-ac2d-7708d1ba305c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:11.535018 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f525f-2940-42d9-ac2d-7708d1ba305c None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:11.535018 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f525f-2940-42d9-ac2d-7708d1ba305c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:11.535237 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f525f-2940-42d9-ac2d-7708d1ba305c None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:11.536556 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f525f-2940-42d9-ac2d-7708d1ba305c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:11.537314 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f525f-2940-42d9-ac2d-7708d1ba305c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:11.561338 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 185/355] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Oct 30 00:43:11 2022] POST /identity/v3/users => generated 248 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:43:11.562259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f525f-2940-42d9-ac2d-7708d1ba305c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:11.612906 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 171/356] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:43:11.719627 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f525f-2940-42d9-ac2d-7708d1ba305c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:11.757074 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbcfe7-a9bd-4f51-89ee-b30475f036dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:11.757729 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbcfe7-a9bd-4f51-89ee-b30475f036dd None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:11.758001 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbcfe7-a9bd-4f51-89ee-b30475f036dd None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:11.758272 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbcfe7-a9bd-4f51-89ee-b30475f036dd None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:11.758982 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbcfe7-a9bd-4f51-89ee-b30475f036dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:11.759281 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbcfe7-a9bd-4f51-89ee-b30475f036dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:11.760761 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbcfe7-a9bd-4f51-89ee-b30475f036dd None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:11.779426 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 186/357] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:11.785072 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a481c-0aae-4440-be34-f8d844e7d283 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:11.840797 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:11.908284 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a481c-0aae-4440-be34-f8d844e7d283 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:11.945506 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51add2a6-d43b-4227-899b-938bae12e311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:11.946112 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51add2a6-d43b-4227-899b-938bae12e311 None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:11.946382 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51add2a6-d43b-4227-899b-938bae12e311 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:11.946649 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51add2a6-d43b-4227-899b-938bae12e311 None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:11.947293 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51add2a6-d43b-4227-899b-938bae12e311 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:11.948699 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51add2a6-d43b-4227-899b-938bae12e311 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:11.972495 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 172/358] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Oct 30 00:43:11 2022] POST /identity/v3/users => generated 249 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:43:12.007770 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbcfe7-a9bd-4f51-89ee-b30475f036dd None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:12.081718 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:12.141456 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbcfe7-a9bd-4f51-89ee-b30475f036dd None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:12.191779 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb506488-e75d-45d3-bf14-1e4dc5fea292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:12.192396 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb506488-e75d-45d3-bf14-1e4dc5fea292 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:12.192675 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb506488-e75d-45d3-bf14-1e4dc5fea292 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:12.192944 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb506488-e75d-45d3-bf14-1e4dc5fea292 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:12.193656 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb506488-e75d-45d3-bf14-1e4dc5fea292 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:12.195022 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb506488-e75d-45d3-bf14-1e4dc5fea292 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:12.207152 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.sql.core [None req-cb506488-e75d-45d3-bf14-1e4dc5fea292 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 30 00:43:12.207152 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 30 00:43:12.207152 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [parameters: {'id': '4873ba1b823d4d0e997dbbec3d1d38a0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 30 00:43:12.207152 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81351) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 30 00:43:12.224170 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-cb506488-e75d-45d3-bf14-1e4dc5fea292 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 30 00:43:12.224170 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:12.224170 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 00:43:12.224170 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 00:43:12.224170 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 00:43:12.224170 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 00:43:12.224170 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 00:43:12.224170 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 00:43:12.224170 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 00:43:12.224170 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application conn.query(q) Oct 30 00:43:12.224170 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 00:43:12.224170 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 00:43:12.224170 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 00:43:12.224170 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application result.read() Oct 30 00:43:12.224170 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 00:43:12.225093 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 00:43:12.225093 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 00:43:12.225093 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 00:43:12.225093 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 00:43:12.225093 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 00:43:12.225093 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 00:43:12.225093 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 00:43:12.225093 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 30 00:43:12.225093 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:12.225093 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 30 00:43:12.225093 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:12.225093 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:12.225093 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 30 00:43:12.225093 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 30 00:43:12.225093 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 30 00:43:12.225093 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return ref.to_dict() Oct 30 00:43:12.225093 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 00:43:12.225093 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application next(self.gen) Oct 30 00:43:12.226065 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 30 00:43:12.226065 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application yield resource Oct 30 00:43:12.226065 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 00:43:12.226065 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application next(self.gen) Oct 30 00:43:12.226065 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 30 00:43:12.226065 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.session.rollback() Oct 30 00:43:12.226065 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 00:43:12.226065 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.force_reraise() Oct 30 00:43:12.226065 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 00:43:12.226065 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise self.value Oct 30 00:43:12.226065 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 30 00:43:12.226065 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 30 00:43:12.226065 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 30 00:43:12.226065 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application session.commit() Oct 30 00:43:12.226065 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 30 00:43:12.226065 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 30 00:43:12.226065 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 30 00:43:12.226926 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._prepare_impl() Oct 30 00:43:12.226926 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 30 00:43:12.226926 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.session.flush() Oct 30 00:43:12.226926 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 30 00:43:12.226926 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._flush(objects) Oct 30 00:43:12.226926 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 30 00:43:12.226926 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 30 00:43:12.226926 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 30 00:43:12.226926 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application compat.raise_( Oct 30 00:43:12.226926 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 00:43:12.226926 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception Oct 30 00:43:12.226926 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 30 00:43:12.226926 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application flush_context.execute() Oct 30 00:43:12.226926 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 30 00:43:12.226926 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rec.execute(self) Oct 30 00:43:12.226926 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 30 00:43:12.226926 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 30 00:43:12.227792 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 30 00:43:12.227792 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 30 00:43:12.227792 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 30 00:43:12.227792 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 30 00:43:12.227792 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 30 00:43:12.227792 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 30 00:43:12.227792 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 30 00:43:12.227792 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 30 00:43:12.227792 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 30 00:43:12.227792 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 30 00:43:12.227792 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 30 00:43:12.227792 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 30 00:43:12.227792 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 30 00:43:12.227792 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 30 00:43:12.227792 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 00:43:12.227792 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception Oct 30 00:43:12.228602 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 00:43:12.228602 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 00:43:12.228602 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 00:43:12.228602 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 00:43:12.228602 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 00:43:12.228602 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 00:43:12.228602 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 00:43:12.228602 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application conn.query(q) Oct 30 00:43:12.228602 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 00:43:12.228602 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 00:43:12.228602 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 00:43:12.228602 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application result.read() Oct 30 00:43:12.228602 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 00:43:12.228602 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 00:43:12.228602 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 00:43:12.228602 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 00:43:12.229526 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 00:43:12.229526 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 00:43:12.229526 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 00:43:12.229526 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 00:43:12.229526 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 30 00:43:12.229526 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 30 00:43:12.229526 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [parameters: {'id': '4873ba1b823d4d0e997dbbec3d1d38a0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 30 00:43:12.229526 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 30 00:43:12.229526 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:12.229526 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:43:12.229526 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:12.229526 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:12.229526 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:12.229526 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:12.229526 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:12.229526 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:12.232042 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:12.232042 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:12.232042 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:12.232042 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:12.232042 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:12.232042 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:12.232042 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 30 00:43:12.232042 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 30 00:43:12.232042 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:12.232042 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:12.232042 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 30 00:43:12.232042 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 30 00:43:12.232042 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 30 00:43:12.232042 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 30 00:43:12.232042 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 30 00:43:12.232042 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:12.234084 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 187/359] 10.222.0.40 () {60 vars in 1131 bytes} [Sun Oct 30 00:43:12 2022] POST /identity/v3/roles => generated 144 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:12.236745 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51add2a6-d43b-4227-899b-938bae12e311 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:12.351613 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:12.354682 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51add2a6-d43b-4227-899b-938bae12e311 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:12.395760 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcac49-78ad-4c93-807b-0b91117771e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:12.396393 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcac49-78ad-4c93-807b-0b91117771e4 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:12.396663 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcac49-78ad-4c93-807b-0b91117771e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:12.396927 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcac49-78ad-4c93-807b-0b91117771e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:12.418097 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fcac49-78ad-4c93-807b-0b91117771e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:43:12.423366 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-35fcac49-78ad-4c93-807b-0b91117771e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:43:12.423366 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:12.423366 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:12.423366 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:12.423366 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:12.423366 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:12.423366 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:12.423366 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:12.423366 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:12.423366 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:12.423366 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:12.423366 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:12.423366 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:43:12.423366 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:43:12.423366 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:43:12.423366 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:43:12.424277 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:43:12.424277 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:43:12.424277 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:43:12.424277 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:43:12.424277 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:12.424277 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:12.424277 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:12.424277 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:12.424277 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:12.424277 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:12.424277 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:12.424277 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:12.424277 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:12.424277 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:12.424277 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:12.424277 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:12.425206 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:12.425206 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:12.425206 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:12.425206 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:12.425206 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:43:12.425206 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:43:12.425206 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:43:12.425206 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:43:12.425206 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:43:12.425206 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:43:12.425206 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:43:12.425206 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:12.425206 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 173/360] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Oct 30 00:43:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:12.430554 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb506488-e75d-45d3-bf14-1e4dc5fea292 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:12.587206 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb506488-e75d-45d3-bf14-1e4dc5fea292 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:12.609649 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:12.639524 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae3870-ebaf-4bd8-a439-744386b244f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:12.640141 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae3870-ebaf-4bd8-a439-744386b244f0 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:12.640418 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae3870-ebaf-4bd8-a439-744386b244f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:12.640688 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae3870-ebaf-4bd8-a439-744386b244f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:12.641384 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae3870-ebaf-4bd8-a439-744386b244f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:12.641747 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae3870-ebaf-4bd8-a439-744386b244f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:12.643117 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae3870-ebaf-4bd8-a439-744386b244f0 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:12.652459 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 188/361] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:43:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:13.363977 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c361ec7-fd22-4d60-9684-24fb6dbdc1ef None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:13.364525 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c361ec7-fd22-4d60-9684-24fb6dbdc1ef None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:13.364525 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c361ec7-fd22-4d60-9684-24fb6dbdc1ef None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:13.366103 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 174/362] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:13.371569 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303c451-6c9f-479f-93f2-20fbab769f00 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:13.371975 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303c451-6c9f-479f-93f2-20fbab769f00 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:13.372157 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303c451-6c9f-479f-93f2-20fbab769f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:13.398542 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-4303c451-6c9f-479f-93f2-20fbab769f00 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:13.399984 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4303c451-6c9f-479f-93f2-20fbab769f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:13.484928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 189/363] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:43:13.811443 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c361ec7-fd22-4d60-9684-24fb6dbdc1ef None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:13.945469 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c361ec7-fd22-4d60-9684-24fb6dbdc1ef None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:13.988651 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236922a2-b286-461d-be94-83520fbb0f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:13.989301 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236922a2-b286-461d-be94-83520fbb0f9c None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:13.989575 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236922a2-b286-461d-be94-83520fbb0f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:13.989847 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236922a2-b286-461d-be94-83520fbb0f9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:14.007244 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236922a2-b286-461d-be94-83520fbb0f9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:43:14.012706 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-236922a2-b286-461d-be94-83520fbb0f9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:43:14.012706 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:14.012706 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:14.012706 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:14.012706 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:14.012706 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:14.012706 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:14.012706 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:14.012706 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:14.012706 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:14.012706 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:14.012706 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:14.012706 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:43:14.012706 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:43:14.012706 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:43:14.012706 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:43:14.013644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:43:14.013644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:43:14.013644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:43:14.013644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:43:14.013644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:14.013644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:14.013644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:14.013644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:14.013644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:14.013644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:14.013644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:14.013644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:14.013644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:14.013644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:14.013644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:14.013644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:14.015044 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:14.015044 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:14.015044 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:14.015044 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:14.015044 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:43:14.015044 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:43:14.015044 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:43:14.015044 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:43:14.015044 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:43:14.015044 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:43:14.015044 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:43:14.015044 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:14.015044 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 175/364] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Oct 30 00:43:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:14.019659 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303c451-6c9f-479f-93f2-20fbab769f00 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:14.173324 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303c451-6c9f-479f-93f2-20fbab769f00 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:14.178494 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:14.206355 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abcccc-044d-4a61-a6c2-2710fedad022 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:14.206545 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abcccc-044d-4a61-a6c2-2710fedad022 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:14.206796 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abcccc-044d-4a61-a6c2-2710fedad022 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:14.208365 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 176/365] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:14.213799 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820b328-3d49-4cc2-a406-f437ee162288 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:14.214074 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820b328-3d49-4cc2-a406-f437ee162288 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:14.214322 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820b328-3d49-4cc2-a406-f437ee162288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:14.222541 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454fc27-6eea-406b-8e63-436a041f0209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:14.223483 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454fc27-6eea-406b-8e63-436a041f0209 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:14.223972 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454fc27-6eea-406b-8e63-436a041f0209 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:14.224450 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454fc27-6eea-406b-8e63-436a041f0209 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:14.225371 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454fc27-6eea-406b-8e63-436a041f0209 None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:14.225909 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454fc27-6eea-406b-8e63-436a041f0209 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:14.227603 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454fc27-6eea-406b-8e63-436a041f0209 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:14.236339 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 190/366] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Oct 30 00:43:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:14.242195 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454fc27-6eea-406b-8e63-436a041f0209 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:14.254423 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-b820b328-3d49-4cc2-a406-f437ee162288 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:14.255639 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-b820b328-3d49-4cc2-a406-f437ee162288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:14.276528 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:14.369514 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454fc27-6eea-406b-8e63-436a041f0209 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:14.392376 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 177/367] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:43:14.394559 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94275e0d-1158-44cf-9a31-6ca740a85f37 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:14.395064 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94275e0d-1158-44cf-9a31-6ca740a85f37 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:14.395567 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94275e0d-1158-44cf-9a31-6ca740a85f37 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:14.397448 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 178/368] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:14.402942 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66def408-09ab-4701-ba4e-16daa273aa59 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:14.403223 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66def408-09ab-4701-ba4e-16daa273aa59 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:14.403722 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66def408-09ab-4701-ba4e-16daa273aa59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:14.411913 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c6782-b1ce-4053-b142-17b057f875e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:14.413167 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c6782-b1ce-4053-b142-17b057f875e4 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:14.413662 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c6782-b1ce-4053-b142-17b057f875e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:14.414147 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c6782-b1ce-4053-b142-17b057f875e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:14.423734 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-66def408-09ab-4701-ba4e-16daa273aa59 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:14.424964 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-66def408-09ab-4701-ba4e-16daa273aa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:14.426131 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c6782-b1ce-4053-b142-17b057f875e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:14.427753 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c6782-b1ce-4053-b142-17b057f875e4 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:14.443184 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-858c6782-b1ce-4053-b142-17b057f875e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:14.443184 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:14.443184 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:14.443184 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:14.443184 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:14.443184 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:14.443184 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:14.443184 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:14.443184 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:14.443184 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:14.443184 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:14.443184 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:14.443184 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:14.443184 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:14.443184 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:14.443184 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:14.444104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:14.444104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:14.444104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:14.444104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:14.444104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:14.444104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:14.444104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:14.444104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:14.444104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:14.444104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:14.444104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:14.444104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:14.444104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:14.444104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:14.444104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:14.444104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:14.444104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:14.444948 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:14.444948 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:14.444948 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:14.447003 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 191/369] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:43:14.455763 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c6782-b1ce-4053-b142-17b057f875e4 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:14.494358 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:14.542212 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 179/370] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:43:14.625312 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c6782-b1ce-4053-b142-17b057f875e4 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:14.669586 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c247d-906c-4235-a3c0-6a8ed153960a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:14.670193 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c247d-906c-4235-a3c0-6a8ed153960a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:14.670472 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c247d-906c-4235-a3c0-6a8ed153960a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:14.670745 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c247d-906c-4235-a3c0-6a8ed153960a None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:14.671758 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c247d-906c-4235-a3c0-6a8ed153960a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:14.671758 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c247d-906c-4235-a3c0-6a8ed153960a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:14.673091 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c247d-906c-4235-a3c0-6a8ed153960a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:14.698557 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 192/371] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:14.703993 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66def408-09ab-4701-ba4e-16daa273aa59 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:14.759218 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c247d-906c-4235-a3c0-6a8ed153960a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:14.811738 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:14.832219 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66def408-09ab-4701-ba4e-16daa273aa59 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:14.868838 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d8162-5d5d-44de-8e83-203596652021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:14.869649 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d8162-5d5d-44de-8e83-203596652021 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:14.870233 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d8162-5d5d-44de-8e83-203596652021 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:14.870358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d8162-5d5d-44de-8e83-203596652021 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:14.875320 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:14.878695 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d8162-5d5d-44de-8e83-203596652021 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:14.880217 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d8162-5d5d-44de-8e83-203596652021 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:14.894342 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-e94d8162-5d5d-44de-8e83-203596652021 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:43:14.894342 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:14.894342 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:14.894342 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:14.894342 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:14.894342 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:14.894342 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:14.894342 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:14.894342 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:14.894342 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:14.894342 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:14.894342 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:14.894342 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:43:14.894342 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:43:14.894342 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:43:14.894342 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:43:14.895270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:14.895270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:14.895270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:43:14.895270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:14.895270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:43:14.895270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:14.895270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:14.895270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:14.895270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:14.895270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:14.895270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:14.895270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:14.895270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:14.895270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:14.895270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:14.895270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:14.895270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:14.895270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:14.897027 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:14.897027 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:14.897027 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:43:14.897027 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:43:14.897027 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:43:14.897027 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:43:14.897027 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:43:14.897027 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:43:14.897027 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:43:14.897027 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:14.897027 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 180/372] 10.222.0.40 () {56 vars in 1093 bytes} [Sun Oct 30 00:43:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:14.897027 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95a07f-6e76-4bb6-9856-ff8cc869b04d None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:14.897027 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95a07f-6e76-4bb6-9856-ff8cc869b04d None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:14.897809 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95a07f-6e76-4bb6-9856-ff8cc869b04d None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:14.898431 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 181/373] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:14.902011 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95a07f-6e76-4bb6-9856-ff8cc869b04d None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:14.903263 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c247d-906c-4235-a3c0-6a8ed153960a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:14.942321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0833a5f-d303-438e-bd73-29523f7f940c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:14.942944 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0833a5f-d303-438e-bd73-29523f7f940c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:14.943219 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0833a5f-d303-438e-bd73-29523f7f940c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:14.943487 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0833a5f-d303-438e-bd73-29523f7f940c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:14.954549 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0833a5f-d303-438e-bd73-29523f7f940c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:43:14.959672 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-f0833a5f-d303-438e-bd73-29523f7f940c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:43:14.959672 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:14.959672 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:14.959672 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:14.959672 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:14.959672 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:14.959672 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:14.959672 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:14.959672 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:14.959672 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:14.959672 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:14.959672 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:14.959672 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:43:14.959672 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:43:14.959672 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:43:14.959672 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:43:14.960558 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:43:14.960558 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:43:14.960558 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:43:14.960558 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:43:14.960558 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:14.960558 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:14.960558 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:14.960558 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:14.960558 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:14.960558 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:14.960558 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:14.960558 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:14.960558 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:14.960558 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:14.960558 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:14.960558 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:14.966536 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:14.966536 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:14.966536 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:14.966536 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:14.966536 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:43:14.966536 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:43:14.966536 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:43:14.966536 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:43:14.966536 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:43:14.966536 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:43:14.966536 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:43:14.966536 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:14.966536 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 193/374] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Oct 30 00:43:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:43:14.966536 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0833a5f-d303-438e-bd73-29523f7f940c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:15.013893 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95a07f-6e76-4bb6-9856-ff8cc869b04d None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:15.051597 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918a4f3-d899-4bd6-9b4b-d258d58c50fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:15.052525 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918a4f3-d899-4bd6-9b4b-d258d58c50fe None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:15.052960 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918a4f3-d899-4bd6-9b4b-d258d58c50fe None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:15.053269 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918a4f3-d899-4bd6-9b4b-d258d58c50fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:15.061636 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:15.066090 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e918a4f3-d899-4bd6-9b4b-d258d58c50fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:43:15.071265 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-e918a4f3-d899-4bd6-9b4b-d258d58c50fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:43:15.071265 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:15.071265 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:15.071265 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:15.071265 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:15.071265 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:15.071265 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:15.071265 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:15.071265 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:15.071265 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:15.071265 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:15.071265 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:15.071265 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:43:15.071265 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:43:15.071265 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:43:15.071265 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:43:15.072155 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:43:15.072155 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:43:15.072155 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:43:15.072155 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:43:15.072155 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:15.072155 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:15.072155 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:15.072155 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:15.072155 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:15.072155 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:15.072155 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:15.072155 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:15.072155 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:15.072155 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:15.072155 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:15.072155 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:15.072952 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:15.072952 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:15.072952 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:15.072952 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:15.072952 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:43:15.072952 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:43:15.072952 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:43:15.072952 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:43:15.072952 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:43:15.072952 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:43:15.072952 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:43:15.072952 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:15.072952 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 182/375] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Oct 30 00:43:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:15.073684 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5ad7e-00c6-4523-890a-eb5d23577708 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:15.074552 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5ad7e-00c6-4523-890a-eb5d23577708 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:15.074552 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5ad7e-00c6-4523-890a-eb5d23577708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:15.079954 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0833a5f-d303-438e-bd73-29523f7f940c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:15.093215 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-5bf5ad7e-00c6-4523-890a-eb5d23577708 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:15.094594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-5bf5ad7e-00c6-4523-890a-eb5d23577708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:15.115872 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cace82-f0dc-481d-8fff-98310830c69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:15.116475 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cace82-f0dc-481d-8fff-98310830c69e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:15.116748 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cace82-f0dc-481d-8fff-98310830c69e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:15.117012 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cace82-f0dc-481d-8fff-98310830c69e None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:15.117760 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cace82-f0dc-481d-8fff-98310830c69e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:15.118054 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cace82-f0dc-481d-8fff-98310830c69e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:15.119471 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cace82-f0dc-481d-8fff-98310830c69e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:15.136812 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:15.157750 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 194/376] 10.222.0.40 () {56 vars in 1133 bytes} [Sun Oct 30 00:43:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:15.157750 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cace82-f0dc-481d-8fff-98310830c69e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:15.173011 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 183/377] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:43:15.173888 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5ad7e-00c6-4523-890a-eb5d23577708 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:15.281714 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cace82-f0dc-481d-8fff-98310830c69e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:15.290615 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5ad7e-00c6-4523-890a-eb5d23577708 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:15.316470 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf420264-debc-4fd6-80af-104f29635a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:15.317047 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf420264-debc-4fd6-80af-104f29635a20 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:15.317367 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf420264-debc-4fd6-80af-104f29635a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:15.317644 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf420264-debc-4fd6-80af-104f29635a20 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:15.318313 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf420264-debc-4fd6-80af-104f29635a20 None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:15.318612 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf420264-debc-4fd6-80af-104f29635a20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:15.319984 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf420264-debc-4fd6-80af-104f29635a20 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:15.325823 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:15.328514 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 195/378] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Oct 30 00:43:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:15.329753 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf420264-debc-4fd6-80af-104f29635a20 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:15.334738 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff7cb2-c8b6-4f1c-9817-5244b34eaf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:15.335614 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff7cb2-c8b6-4f1c-9817-5244b34eaf74 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:15.336130 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff7cb2-c8b6-4f1c-9817-5244b34eaf74 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:15.336608 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff7cb2-c8b6-4f1c-9817-5244b34eaf74 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:15.337589 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff7cb2-c8b6-4f1c-9817-5244b34eaf74 None admin] RBAC: Adding query filter params (name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:15.338118 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff7cb2-c8b6-4f1c-9817-5244b34eaf74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:15.340662 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff7cb2-c8b6-4f1c-9817-5244b34eaf74 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:15.351351 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 184/379] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Oct 30 00:43:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:15.352836 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff7cb2-c8b6-4f1c-9817-5244b34eaf74 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:15.413941 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:15.464006 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf420264-debc-4fd6-80af-104f29635a20 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:15.466112 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff7cb2-c8b6-4f1c-9817-5244b34eaf74 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:15.503912 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d8ca9-cf62-4101-954a-121b2a541eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:15.504537 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d8ca9-cf62-4101-954a-121b2a541eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:15.504811 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d8ca9-cf62-4101-954a-121b2a541eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:15.505074 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d8ca9-cf62-4101-954a-121b2a541eb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:15.505945 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce26d0f-5dfc-4de2-94b7-428553657984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:15.506568 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce26d0f-5dfc-4de2-94b7-428553657984 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:15.506959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce26d0f-5dfc-4de2-94b7-428553657984 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:15.507232 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce26d0f-5dfc-4de2-94b7-428553657984 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:15.515507 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d8ca9-cf62-4101-954a-121b2a541eb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:15.516963 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d8ca9-cf62-4101-954a-121b2a541eb1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:15.518522 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce26d0f-5dfc-4de2-94b7-428553657984 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:15.520481 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce26d0f-5dfc-4de2-94b7-428553657984 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:15.531250 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-ea6d8ca9-cf62-4101-954a-121b2a541eb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:15.531250 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:15.531250 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:15.531250 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:15.531250 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:15.531250 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:15.531250 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:15.531250 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:15.531250 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:15.531250 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:15.531250 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:15.531250 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:15.531250 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:15.531250 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:15.531250 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:15.531250 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:15.532208 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:15.532208 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:15.532208 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:15.532208 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:15.532208 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:15.532208 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:15.532208 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:15.532208 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:15.532208 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:15.532208 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:15.532208 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:15.532208 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:15.532208 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:15.532208 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:15.532208 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:15.532208 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:15.532208 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:15.533058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:15.533058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:15.533058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:15.533058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 196/380] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:15.533316 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d8ca9-cf62-4101-954a-121b2a541eb1 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:15.535654 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-1ce26d0f-5dfc-4de2-94b7-428553657984 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:15.535654 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:15.535654 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:15.535654 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:15.535654 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:15.535654 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:15.535654 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:15.535654 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:15.535654 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:15.535654 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:15.535654 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:15.535654 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:15.535654 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:15.535654 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:15.535654 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:15.535654 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:15.536566 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:15.536566 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:15.536566 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:15.536566 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:15.536566 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:15.536566 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:15.536566 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:15.536566 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:15.536566 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:15.536566 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:15.536566 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:15.536566 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:15.536566 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:15.536566 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:15.536566 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:15.536566 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:15.536566 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:15.537798 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:15.537798 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:15.537798 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:15.538366 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 185/381] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:15.539290 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce26d0f-5dfc-4de2-94b7-428553657984 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:15.590075 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:15.642647 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d8ca9-cf62-4101-954a-121b2a541eb1 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:15.645856 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce26d0f-5dfc-4de2-94b7-428553657984 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:15.652826 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:15.679526 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acd343-a440-4ca9-9e72-c90518e36acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:15.680150 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acd343-a440-4ca9-9e72-c90518e36acf None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:15.680423 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acd343-a440-4ca9-9e72-c90518e36acf None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:15.680699 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acd343-a440-4ca9-9e72-c90518e36acf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:15.686557 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50053a4-9009-4ed7-80c9-192d24941b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:15.687162 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50053a4-9009-4ed7-80c9-192d24941b56 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:15.687430 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50053a4-9009-4ed7-80c9-192d24941b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:15.687696 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50053a4-9009-4ed7-80c9-192d24941b56 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:15.691960 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9acd343-a440-4ca9-9e72-c90518e36acf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:15.693443 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9acd343-a440-4ca9-9e72-c90518e36acf None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:15.698209 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50053a4-9009-4ed7-80c9-192d24941b56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:43:15.704270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-f50053a4-9009-4ed7-80c9-192d24941b56 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:43:15.704270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:15.704270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:15.704270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:15.704270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:15.704270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:15.704270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:15.704270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:15.704270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:15.704270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:15.704270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:15.704270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:15.704270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:43:15.704270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:43:15.704270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:43:15.704270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:43:15.705218 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:43:15.705218 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:43:15.705218 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:43:15.705218 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:43:15.705218 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:15.705218 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:15.705218 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:15.705218 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:15.705218 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:15.705218 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:15.705218 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:15.705218 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:15.705218 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:15.705218 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:15.705218 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:15.705218 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:15.706045 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:15.706045 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:15.706045 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:15.706045 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:15.706045 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:43:15.706045 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:43:15.706045 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:43:15.706045 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:43:15.706045 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:43:15.706045 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:43:15.706045 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:43:15.706045 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:15.706045 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 186/382] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Oct 30 00:43:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:15.706867 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50053a4-9009-4ed7-80c9-192d24941b56 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:15.707563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-f9acd343-a440-4ca9-9e72-c90518e36acf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:15.707563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:15.707563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:15.707563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:15.707563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:15.707563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:15.707563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:15.707563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:15.707563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:15.707563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:15.707563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:15.707563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:15.707563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:15.707563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:15.707563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:15.707563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:15.708428 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:15.708428 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:15.708428 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:15.708428 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:15.708428 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:15.708428 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:15.708428 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:15.708428 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:15.708428 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:15.708428 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:15.708428 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:15.708428 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:15.708428 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:15.708428 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:15.708428 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:15.708428 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:15.708428 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:15.709323 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:15.709323 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:15.709323 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:15.709323 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 197/383] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:15.709885 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acd343-a440-4ca9-9e72-c90518e36acf None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:15.806273 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50053a4-9009-4ed7-80c9-192d24941b56 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:15.808507 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:15.809740 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acd343-a440-4ca9-9e72-c90518e36acf None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:15.841026 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117c67e-1d8e-4bc6-b46d-754b968df4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:15.841645 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117c67e-1d8e-4bc6-b46d-754b968df4ad None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:15.841922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117c67e-1d8e-4bc6-b46d-754b968df4ad None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:15.842193 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117c67e-1d8e-4bc6-b46d-754b968df4ad None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:15.842822 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117c67e-1d8e-4bc6-b46d-754b968df4ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:15.843127 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117c67e-1d8e-4bc6-b46d-754b968df4ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:15.843223 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed6203-0c55-4c34-9b6c-b3c25e8ab165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:15.843773 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed6203-0c55-4c34-9b6c-b3c25e8ab165 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:15.844051 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed6203-0c55-4c34-9b6c-b3c25e8ab165 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:15.844320 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed6203-0c55-4c34-9b6c-b3c25e8ab165 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:15.844485 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117c67e-1d8e-4bc6-b46d-754b968df4ad None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:15.844947 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed6203-0c55-4c34-9b6c-b3c25e8ab165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:15.845276 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed6203-0c55-4c34-9b6c-b3c25e8ab165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:15.846623 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed6203-0c55-4c34-9b6c-b3c25e8ab165 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:15.855758 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 187/384] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:15.856983 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556e4fa-c1d7-48ef-9df3-49a40edfce8b None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:15.857297 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556e4fa-c1d7-48ef-9df3-49a40edfce8b None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:15.857573 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556e4fa-c1d7-48ef-9df3-49a40edfce8b None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:15.858394 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 198/385] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:15.861229 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 188/386] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:15.861356 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed6203-0c55-4c34-9b6c-b3c25e8ab165 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:15.861448 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556e4fa-c1d7-48ef-9df3-49a40edfce8b None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:15.887818 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:15.961728 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed6203-0c55-4c34-9b6c-b3c25e8ab165 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:15.962340 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556e4fa-c1d7-48ef-9df3-49a40edfce8b None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:15.995101 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423714b-aa62-4b2f-91f6-409439631d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:15.995689 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423714b-aa62-4b2f-91f6-409439631d47 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:15.995965 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423714b-aa62-4b2f-91f6-409439631d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:15.996178 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b4a12-6608-48d7-a813-385e8ec5dbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:15.996282 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423714b-aa62-4b2f-91f6-409439631d47 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:15.996768 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b4a12-6608-48d7-a813-385e8ec5dbb1 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:15.996893 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423714b-aa62-4b2f-91f6-409439631d47 None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:15.997107 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b4a12-6608-48d7-a813-385e8ec5dbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:15.997231 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423714b-aa62-4b2f-91f6-409439631d47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:15.997413 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b4a12-6608-48d7-a813-385e8ec5dbb1 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:15.998091 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b4a12-6608-48d7-a813-385e8ec5dbb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:15.998391 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b4a12-6608-48d7-a813-385e8ec5dbb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:15.998546 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423714b-aa62-4b2f-91f6-409439631d47 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:15.999740 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b4a12-6608-48d7-a813-385e8ec5dbb1 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:16.006155 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 199/387] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Oct 30 00:43:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:16.006926 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423714b-aa62-4b2f-91f6-409439631d47 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:16.014245 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 189/388] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:16.015694 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4db7e-975c-4cd9-a123-8e9a4660acd8 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:16.015981 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4db7e-975c-4cd9-a123-8e9a4660acd8 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:16.016254 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4db7e-975c-4cd9-a123-8e9a4660acd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:16.034338 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-7fe4db7e-975c-4cd9-a123-8e9a4660acd8 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:16.035526 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-7fe4db7e-975c-4cd9-a123-8e9a4660acd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:16.052458 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:16.093963 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:16.101007 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 190/389] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:43:16.102011 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4db7e-975c-4cd9-a123-8e9a4660acd8 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:16.111003 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423714b-aa62-4b2f-91f6-409439631d47 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:16.145600 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698c4f4-0695-4dfe-973a-8945414e25c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:16.146218 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698c4f4-0695-4dfe-973a-8945414e25c0 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:16.146494 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698c4f4-0695-4dfe-973a-8945414e25c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:16.146762 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698c4f4-0695-4dfe-973a-8945414e25c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:16.154196 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698c4f4-0695-4dfe-973a-8945414e25c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:16.155605 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698c4f4-0695-4dfe-973a-8945414e25c0 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:16.167363 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-0698c4f4-0695-4dfe-973a-8945414e25c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:16.167363 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:16.167363 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:16.167363 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:16.167363 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:16.167363 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:16.167363 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:16.167363 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:16.167363 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:16.167363 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:16.167363 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:16.167363 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:16.167363 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:43:16.167363 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:43:16.167363 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:43:16.168259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:43:16.168259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:16.168259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:16.168259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:16.168259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:16.168259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:16.168259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:16.168259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:16.168259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:16.168259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:16.168259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:16.168259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:16.168259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:16.168259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:16.168259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:16.168259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:16.168259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:16.169124 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:43:16.169124 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:43:16.169124 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:43:16.169124 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:43:16.169124 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:43:16.169124 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:43:16.169124 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:16.169124 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:16.169124 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 200/390] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:43:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:16.169640 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698c4f4-0695-4dfe-973a-8945414e25c0 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:16.213242 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4db7e-975c-4cd9-a123-8e9a4660acd8 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:16.249470 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa42e6a-7578-4efb-b1fc-0d4c0d2c546f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:16.250092 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa42e6a-7578-4efb-b1fc-0d4c0d2c546f None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:16.250368 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa42e6a-7578-4efb-b1fc-0d4c0d2c546f None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:16.250644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa42e6a-7578-4efb-b1fc-0d4c0d2c546f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:16.258025 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa42e6a-7578-4efb-b1fc-0d4c0d2c546f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:16.260449 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa42e6a-7578-4efb-b1fc-0d4c0d2c546f None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:16.275308 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-ffa42e6a-7578-4efb-b1fc-0d4c0d2c546f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 30 00:43:16.275308 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:16.275308 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:16.275308 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:16.275308 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:16.275308 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:16.275308 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:16.275308 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:16.275308 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:16.275308 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:16.275308 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:16.275308 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:16.275308 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:43:16.275308 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:43:16.275308 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:43:16.275308 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:43:16.276203 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:16.276203 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:16.276203 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:43:16.276203 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:16.276203 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:43:16.276203 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:16.276203 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:16.276203 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:16.276203 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:16.276203 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:16.276203 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:16.276203 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:16.276203 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:16.276203 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:16.276203 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:16.276203 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:16.276203 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:16.276203 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:16.277087 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:16.277087 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:16.277087 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:43:16.277087 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:43:16.277087 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:43:16.277087 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:43:16.277087 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:43:16.277087 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:43:16.277087 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 30 00:43:16.277087 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:16.277690 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698c4f4-0695-4dfe-973a-8945414e25c0 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:16.281231 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 191/391] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:43:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:16.282061 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa42e6a-7578-4efb-b1fc-0d4c0d2c546f None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:16.298500 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:16.314008 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1b437-913c-4b14-87e0-d3025d051aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:16.314632 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1b437-913c-4b14-87e0-d3025d051aee None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:16.314912 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1b437-913c-4b14-87e0-d3025d051aee None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:16.315187 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1b437-913c-4b14-87e0-d3025d051aee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:16.326546 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1b437-913c-4b14-87e0-d3025d051aee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:16.327990 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1b437-913c-4b14-87e0-d3025d051aee None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:16.330563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:16.343629 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-f4d1b437-913c-4b14-87e0-d3025d051aee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:16.343629 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:16.343629 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:16.343629 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:16.343629 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:16.343629 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:16.343629 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:16.343629 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:16.343629 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:16.343629 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:16.343629 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:16.343629 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:16.343629 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:16.343629 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:16.343629 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:16.343629 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:16.344623 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:16.344623 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:16.344623 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:16.344623 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:16.344623 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:16.344623 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:16.344623 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:16.344623 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:16.344623 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:16.344623 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:16.344623 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:16.344623 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:16.344623 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:16.344623 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:16.344623 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:16.344623 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:16.344623 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:16.345533 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:16.345533 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:16.345533 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:16.345533 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 201/392] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:16.345533 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1b437-913c-4b14-87e0-d3025d051aee None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:16.391862 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa42e6a-7578-4efb-b1fc-0d4c0d2c546f None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:16.425029 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffcb86-87f1-4c29-b359-7a89ff93903f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:16.425672 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffcb86-87f1-4c29-b359-7a89ff93903f None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:16.425947 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffcb86-87f1-4c29-b359-7a89ff93903f None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:16.426214 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffcb86-87f1-4c29-b359-7a89ff93903f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:16.433722 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffcb86-87f1-4c29-b359-7a89ff93903f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:16.435154 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffcb86-87f1-4c29-b359-7a89ff93903f None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:16.443129 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1b437-913c-4b14-87e0-d3025d051aee None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:16.445983 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-dfffcb86-87f1-4c29-b359-7a89ff93903f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 30 00:43:16.445983 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:16.445983 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:16.445983 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:16.445983 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:16.445983 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:16.445983 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:16.445983 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:16.445983 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:16.445983 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:16.445983 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:16.445983 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:16.445983 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:43:16.445983 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:43:16.445983 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:43:16.445983 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:43:16.446959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:16.446959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:16.446959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:43:16.446959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:16.446959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:43:16.446959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:16.446959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:16.446959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:16.446959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:16.446959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:16.446959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:16.446959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:16.446959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:16.446959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:16.446959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:16.446959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:16.446959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:16.446959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:16.447845 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:16.447845 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:16.447845 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:43:16.447845 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:43:16.447845 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:43:16.447845 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:43:16.447845 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:43:16.447845 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:43:16.447845 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 30 00:43:16.447845 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:16.447845 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 192/393] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:43:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:16.448409 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffcb86-87f1-4c29-b359-7a89ff93903f None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:16.478744 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fb04f-b45e-4454-b95f-8b45d42c6a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:16.479345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fb04f-b45e-4454-b95f-8b45d42c6a14 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:16.479624 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fb04f-b45e-4454-b95f-8b45d42c6a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:16.479895 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fb04f-b45e-4454-b95f-8b45d42c6a14 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:16.480694 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7fb04f-b45e-4454-b95f-8b45d42c6a14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:16.480913 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7fb04f-b45e-4454-b95f-8b45d42c6a14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:16.482395 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7fb04f-b45e-4454-b95f-8b45d42c6a14 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:16.499997 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 202/394] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Oct 30 00:43:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:16.500713 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fb04f-b45e-4454-b95f-8b45d42c6a14 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:16.524814 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:16.551687 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffcb86-87f1-4c29-b359-7a89ff93903f None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:16.556781 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:16.585976 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6d8df-50bb-43ee-8ca7-d13889c60189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:16.586559 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6d8df-50bb-43ee-8ca7-d13889c60189 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:16.586832 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6d8df-50bb-43ee-8ca7-d13889c60189 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:16.587094 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6d8df-50bb-43ee-8ca7-d13889c60189 None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:16.587799 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe6d8df-50bb-43ee-8ca7-d13889c60189 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:16.588097 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe6d8df-50bb-43ee-8ca7-d13889c60189 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:16.589530 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe6d8df-50bb-43ee-8ca7-d13889c60189 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:16.602135 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fb04f-b45e-4454-b95f-8b45d42c6a14 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:16.624734 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 193/395] 10.222.0.40 () {56 vars in 1137 bytes} [Sun Oct 30 00:43:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:16.625587 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6d8df-50bb-43ee-8ca7-d13889c60189 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:16.641598 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23809b31-dc68-4de2-a9a6-53fca17bcfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:16.642202 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23809b31-dc68-4de2-a9a6-53fca17bcfde None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:16.642478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23809b31-dc68-4de2-a9a6-53fca17bcfde None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:16.642748 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23809b31-dc68-4de2-a9a6-53fca17bcfde None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:16.643387 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23809b31-dc68-4de2-a9a6-53fca17bcfde None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:16.643690 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23809b31-dc68-4de2-a9a6-53fca17bcfde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:16.645058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23809b31-dc68-4de2-a9a6-53fca17bcfde None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:16.656298 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 203/396] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:16.657073 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23809b31-dc68-4de2-a9a6-53fca17bcfde None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:16.727535 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6d8df-50bb-43ee-8ca7-d13889c60189 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:16.756333 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:16.758657 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23809b31-dc68-4de2-a9a6-53fca17bcfde None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:16.761723 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a82bcd-c788-4c9d-a2c7-f6b87398b497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:16.762396 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a82bcd-c788-4c9d-a2c7-f6b87398b497 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:16.762673 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a82bcd-c788-4c9d-a2c7-f6b87398b497 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:16.762966 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a82bcd-c788-4c9d-a2c7-f6b87398b497 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:16.772957 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a82bcd-c788-4c9d-a2c7-f6b87398b497 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:16.774710 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a82bcd-c788-4c9d-a2c7-f6b87398b497 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:16.775076 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:16.790200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-d9a82bcd-c788-4c9d-a2c7-f6b87398b497 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:16.790200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:16.790200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:16.790200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:16.790200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:16.790200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:16.790200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:16.790200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:16.790200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:16.790200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:16.790200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:16.790200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:16.790200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:16.790200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:16.790200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:16.790200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:16.791143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:16.791143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:16.791143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:16.791143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:16.791143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:16.791143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:16.791143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:16.791143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:16.791143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:16.791143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:16.791143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:16.791143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:16.791143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:16.791143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:16.791143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:16.791143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:16.791143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:16.792570 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:16.792570 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:16.792570 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:16.792570 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 194/397] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:16.792570 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a82bcd-c788-4c9d-a2c7-f6b87398b497 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:16.794593 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c635f-529a-4c36-84cb-144aae559df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:16.795196 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c635f-529a-4c36-84cb-144aae559df9 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:16.795499 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c635f-529a-4c36-84cb-144aae559df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:16.795742 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c635f-529a-4c36-84cb-144aae559df9 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:16.796490 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c635f-529a-4c36-84cb-144aae559df9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:16.796903 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c635f-529a-4c36-84cb-144aae559df9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:16.798195 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c635f-529a-4c36-84cb-144aae559df9 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:16.815098 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 204/398] 10.222.0.40 () {56 vars in 1137 bytes} [Sun Oct 30 00:43:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:16.815886 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c635f-529a-4c36-84cb-144aae559df9 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:16.893625 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a82bcd-c788-4c9d-a2c7-f6b87398b497 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:16.916035 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c635f-529a-4c36-84cb-144aae559df9 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:16.927022 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c07235-cb30-41aa-9bff-1945903f2ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:16.927661 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c07235-cb30-41aa-9bff-1945903f2ed8 None admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:16.927934 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c07235-cb30-41aa-9bff-1945903f2ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:16.928202 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c07235-cb30-41aa-9bff-1945903f2ed8 None admin] PATH_INFO: `/v3/projects/8969ed754fe24784a2025cbdbf6f1a8b/users/4237b425d9fa4a60b10802e5b108d542/roles/53b761158f744776b470f11e00bdaa81` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:16.942318 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c07235-cb30-41aa-9bff-1945903f2ed8 None admin] RBAC: Authorizing `identity:create_grant(project_id=8969ed754fe24784a2025cbdbf6f1a8b, user_id=4237b425d9fa4a60b10802e5b108d542, role_id=53b761158f744776b470f11e00bdaa81)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:16.943751 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c07235-cb30-41aa-9bff-1945903f2ed8 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:16.948282 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b10a8-731f-4b2f-81c2-feafdc4b06cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:16.948950 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b10a8-731f-4b2f-81c2-feafdc4b06cb None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:16.949172 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b10a8-731f-4b2f-81c2-feafdc4b06cb None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:16.950008 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b10a8-731f-4b2f-81c2-feafdc4b06cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:16.956360 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 195/399] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Oct 30 00:43:16 2022] PUT /identity/v3/projects/8969ed754fe24784a2025cbdbf6f1a8b/users/4237b425d9fa4a60b10802e5b108d542/roles/53b761158f744776b470f11e00bdaa81 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:43:16.958556 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c07235-cb30-41aa-9bff-1945903f2ed8 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:16.959974 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b10a8-731f-4b2f-81c2-feafdc4b06cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:16.961459 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b10a8-731f-4b2f-81c2-feafdc4b06cb None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:16.978260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-6a8b10a8-731f-4b2f-81c2-feafdc4b06cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:16.978260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:16.978260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:16.978260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:16.978260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:16.978260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:16.978260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:16.978260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:16.978260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:16.978260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:16.978260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:16.978260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:16.978260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:16.978260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:16.978260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:16.978260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:16.979272 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:16.979272 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:16.979272 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:16.979272 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:16.979272 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:16.979272 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:16.979272 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:16.979272 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:16.979272 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:16.979272 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:16.979272 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:16.979272 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:16.979272 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:16.979272 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:16.979272 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:16.979272 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:16.979272 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:16.980137 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:16.980137 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:16.980137 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:16.980137 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 205/400] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:16.981158 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b10a8-731f-4b2f-81c2-feafdc4b06cb None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:17.000677 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:17.014628 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:17.079337 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c07235-cb30-41aa-9bff-1945903f2ed8 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:17.098180 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b10a8-731f-4b2f-81c2-feafdc4b06cb None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:17.117836 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2c33a-a778-4421-ae60-7da40991d47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:17.118463 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2c33a-a778-4421-ae60-7da40991d47d None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:17.118737 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2c33a-a778-4421-ae60-7da40991d47d None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:17.119004 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2c33a-a778-4421-ae60-7da40991d47d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:17.126447 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2c33a-a778-4421-ae60-7da40991d47d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:17.127875 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2c33a-a778-4421-ae60-7da40991d47d None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:17.141539 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-e1b2c33a-a778-4421-ae60-7da40991d47d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 30 00:43:17.141539 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:17.141539 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:17.141539 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:17.141539 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:17.141539 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:17.141539 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:17.141539 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:17.141539 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:17.141539 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:17.141539 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:17.141539 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:17.141539 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:43:17.141539 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:43:17.141539 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:43:17.141539 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:43:17.142651 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:17.142651 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:17.142651 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:43:17.142651 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:17.142651 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:43:17.142651 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:17.142651 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:17.142651 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:17.142651 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:17.142651 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:17.142651 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:17.142651 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:17.142651 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:17.142651 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:17.142651 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:17.142651 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:17.142651 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:17.142651 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:17.144028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:17.144028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:17.144028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:43:17.144028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:43:17.144028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:43:17.144028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:43:17.144028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:43:17.144028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:43:17.144028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 30 00:43:17.144028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:17.144028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 196/401] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Oct 30 00:43:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:17.144028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2c33a-a778-4421-ae60-7da40991d47d None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:17.149238 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfee166-545c-4cc2-a628-9309d8874d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:17.149862 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfee166-545c-4cc2-a628-9309d8874d90 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:17.150138 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfee166-545c-4cc2-a628-9309d8874d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:17.150400 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfee166-545c-4cc2-a628-9309d8874d90 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:17.151034 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfee166-545c-4cc2-a628-9309d8874d90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:17.151327 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfee166-545c-4cc2-a628-9309d8874d90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:17.153304 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfee166-545c-4cc2-a628-9309d8874d90 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:17.165496 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 206/402] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:17.166148 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfee166-545c-4cc2-a628-9309d8874d90 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:17.250961 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:17.261050 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2c33a-a778-4421-ae60-7da40991d47d None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:17.263424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:17.279631 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfee166-545c-4cc2-a628-9309d8874d90 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:17.298867 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa9dc7-68f0-4cc1-83f2-49ca5cc0c0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:17.299496 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa9dc7-68f0-4cc1-83f2-49ca5cc0c0da None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:17.300039 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa9dc7-68f0-4cc1-83f2-49ca5cc0c0da None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:17.300039 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa9dc7-68f0-4cc1-83f2-49ca5cc0c0da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:17.311818 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa9dc7-68f0-4cc1-83f2-49ca5cc0c0da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:17.313683 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa9dc7-68f0-4cc1-83f2-49ca5cc0c0da None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:17.314071 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1cd30-0743-42f2-87fe-67fca216bd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:17.314665 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1cd30-0743-42f2-87fe-67fca216bd89 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:17.314939 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1cd30-0743-42f2-87fe-67fca216bd89 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:17.315204 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1cd30-0743-42f2-87fe-67fca216bd89 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:17.315829 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1cd30-0743-42f2-87fe-67fca216bd89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:17.316124 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1cd30-0743-42f2-87fe-67fca216bd89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:17.317511 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1cd30-0743-42f2-87fe-67fca216bd89 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:17.329087 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 207/403] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:17.329906 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1cd30-0743-42f2-87fe-67fca216bd89 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:17.330865 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-2cfa9dc7-68f0-4cc1-83f2-49ca5cc0c0da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:17.330865 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:17.330865 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:17.330865 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:17.330865 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:17.330865 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:17.330865 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:17.330865 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:17.330865 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:17.330865 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:17.330865 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:17.330865 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:17.330865 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:17.330865 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:17.330865 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:17.330865 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:17.331746 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:17.331746 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:17.331746 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:17.331746 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:17.331746 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:17.331746 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:17.331746 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:17.331746 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:17.331746 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:17.331746 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:17.331746 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:17.331746 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:17.331746 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:17.331746 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:17.331746 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:17.331746 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:17.331746 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:17.332725 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:17.332725 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:17.332725 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:17.336474 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 197/404] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:17.337297 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa9dc7-68f0-4cc1-83f2-49ca5cc0c0da None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:17.435006 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1cd30-0743-42f2-87fe-67fca216bd89 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:17.443149 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa9dc7-68f0-4cc1-83f2-49ca5cc0c0da None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:17.469749 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ac6cd-5379-4fd5-8267-9127212b82d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:17.470411 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ac6cd-5379-4fd5-8267-9127212b82d8 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:17.470711 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ac6cd-5379-4fd5-8267-9127212b82d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:17.470957 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ac6cd-5379-4fd5-8267-9127212b82d8 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:17.471675 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ac6cd-5379-4fd5-8267-9127212b82d8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:17.471976 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ac6cd-5379-4fd5-8267-9127212b82d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:17.473433 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ac6cd-5379-4fd5-8267-9127212b82d8 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:17.479429 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64d9a6-4925-43cd-b2bd-af8b4ad51042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:17.480023 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64d9a6-4925-43cd-b2bd-af8b4ad51042 None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:17.480298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64d9a6-4925-43cd-b2bd-af8b4ad51042 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:17.480582 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64d9a6-4925-43cd-b2bd-af8b4ad51042 None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:17.481272 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64d9a6-4925-43cd-b2bd-af8b4ad51042 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:17.482699 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64d9a6-4925-43cd-b2bd-af8b4ad51042 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:17.495791 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 208/405] 10.222.0.40 () {56 vars in 1139 bytes} [Sun Oct 30 00:43:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:17.495791 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ac6cd-5379-4fd5-8267-9127212b82d8 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:17.500726 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:17.512460 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 198/406] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Oct 30 00:43:17 2022] POST /identity/v3/users => generated 247 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:43:17.513863 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64d9a6-4925-43cd-b2bd-af8b4ad51042 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:17.524477 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:17.630019 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ac6cd-5379-4fd5-8267-9127212b82d8 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:17.682076 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f6b74-c135-4846-8597-c094e7ff422d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:17.682723 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f6b74-c135-4846-8597-c094e7ff422d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:17.683022 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f6b74-c135-4846-8597-c094e7ff422d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:17.683786 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f6b74-c135-4846-8597-c094e7ff422d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:17.693733 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64d9a6-4925-43cd-b2bd-af8b4ad51042 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:17.694192 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f6b74-c135-4846-8597-c094e7ff422d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:17.694835 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f6b74-c135-4846-8597-c094e7ff422d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:17.711511 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-fe9f6b74-c135-4846-8597-c094e7ff422d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:17.711511 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:17.711511 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:17.711511 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:17.711511 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:17.711511 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:17.711511 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:17.711511 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:17.711511 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:17.711511 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:17.711511 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:17.711511 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:17.711511 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:43:17.711511 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:43:17.711511 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:43:17.712423 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:43:17.712423 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:17.712423 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:17.712423 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:17.712423 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:17.712423 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:17.712423 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:17.712423 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:17.712423 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:17.712423 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:17.712423 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:17.712423 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:17.712423 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:17.712423 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:17.712423 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:17.712423 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:17.712423 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:17.713303 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:43:17.713303 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:43:17.713303 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:43:17.713303 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:43:17.713303 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:43:17.713303 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:43:17.713303 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:17.713303 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:17.713303 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 209/407] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:43:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:17.714236 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f6b74-c135-4846-8597-c094e7ff422d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:17.740583 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961aa0b8-ceeb-46f2-9728-18e15bf2950d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:17.741199 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961aa0b8-ceeb-46f2-9728-18e15bf2950d None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:17.741778 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961aa0b8-ceeb-46f2-9728-18e15bf2950d None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:17.742052 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961aa0b8-ceeb-46f2-9728-18e15bf2950d None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:17.742861 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961aa0b8-ceeb-46f2-9728-18e15bf2950d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:17.743164 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961aa0b8-ceeb-46f2-9728-18e15bf2950d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:17.744891 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961aa0b8-ceeb-46f2-9728-18e15bf2950d None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:17.766071 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 199/408] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:17.767208 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961aa0b8-ceeb-46f2-9728-18e15bf2950d None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:17.798184 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:17.838712 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:17.847241 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f6b74-c135-4846-8597-c094e7ff422d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:17.888436 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961aa0b8-ceeb-46f2-9728-18e15bf2950d None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:17.893610 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be778f38-ebd0-41ee-91c6-92a3e10ebc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:17.894439 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be778f38-ebd0-41ee-91c6-92a3e10ebc26 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:17.894851 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be778f38-ebd0-41ee-91c6-92a3e10ebc26 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:17.895254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be778f38-ebd0-41ee-91c6-92a3e10ebc26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:17.910690 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be778f38-ebd0-41ee-91c6-92a3e10ebc26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:17.912836 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be778f38-ebd0-41ee-91c6-92a3e10ebc26 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:17.927366 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27373c5-2730-4687-b085-e972cb58ae8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:17.927964 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27373c5-2730-4687-b085-e972cb58ae8b None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:17.928250 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27373c5-2730-4687-b085-e972cb58ae8b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:17.928502 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27373c5-2730-4687-b085-e972cb58ae8b None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:17.929181 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27373c5-2730-4687-b085-e972cb58ae8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:17.929505 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27373c5-2730-4687-b085-e972cb58ae8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:17.930915 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27373c5-2730-4687-b085-e972cb58ae8b None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:17.943538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-be778f38-ebd0-41ee-91c6-92a3e10ebc26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:17.943538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:17.943538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:17.943538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:17.943538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:17.943538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:17.943538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:17.943538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:17.943538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:17.943538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:17.943538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:17.943538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:17.943538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:17.943538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:17.943538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:17.943538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:17.944493 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:17.944493 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:17.944493 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:17.944493 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:17.944493 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:17.944493 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:17.944493 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:17.944493 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:17.944493 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:17.944493 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:17.944493 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:17.944493 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:17.944493 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:17.944493 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:17.944493 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:17.944493 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:17.944493 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:17.945387 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:17.945387 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:17.945387 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:17.945387 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 210/409] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:17.949999 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be778f38-ebd0-41ee-91c6-92a3e10ebc26 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:17.954212 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 200/410] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Oct 30 00:43:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:17.955136 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27373c5-2730-4687-b085-e972cb58ae8b None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:18.082420 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27373c5-2730-4687-b085-e972cb58ae8b None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:18.083505 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be778f38-ebd0-41ee-91c6-92a3e10ebc26 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:18.104540 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:18.120530 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:18.124817 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b6206-d930-4b95-954b-eda46ae34243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:18.125155 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83f651-c578-447a-abbf-37999463a1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:18.125708 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b6206-d930-4b95-954b-eda46ae34243 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:18.126084 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b6206-d930-4b95-954b-eda46ae34243 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:18.126294 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83f651-c578-447a-abbf-37999463a1ce None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:18.126543 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b6206-d930-4b95-954b-eda46ae34243 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:18.126855 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83f651-c578-447a-abbf-37999463a1ce None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:18.127265 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83f651-c578-447a-abbf-37999463a1ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:18.127433 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b6206-d930-4b95-954b-eda46ae34243 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:18.127828 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b6206-d930-4b95-954b-eda46ae34243 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:18.129588 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b6206-d930-4b95-954b-eda46ae34243 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:18.134946 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83f651-c578-447a-abbf-37999463a1ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:18.136618 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83f651-c578-447a-abbf-37999463a1ce None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:18.142723 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 201/411] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:18.143656 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b6206-d930-4b95-954b-eda46ae34243 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:18.149751 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-3d83f651-c578-447a-abbf-37999463a1ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:18.149751 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:18.149751 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:18.149751 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:18.149751 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:18.149751 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:18.149751 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:18.149751 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:18.149751 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:18.149751 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:18.149751 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:18.149751 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:18.149751 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:43:18.149751 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:43:18.149751 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:43:18.150784 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:43:18.150784 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:18.150784 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:18.150784 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:18.150784 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:18.150784 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:18.150784 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:18.150784 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:18.150784 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:18.150784 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:18.150784 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:18.150784 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:18.150784 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:18.150784 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:18.150784 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:18.150784 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:18.150784 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:18.151860 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:43:18.151860 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:43:18.151860 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:43:18.151860 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:43:18.151860 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:43:18.151860 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:43:18.151860 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:18.151860 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:18.153863 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 211/412] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:43:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:18.154776 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83f651-c578-447a-abbf-37999463a1ce None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:18.262833 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b6206-d930-4b95-954b-eda46ae34243 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:18.265774 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83f651-c578-447a-abbf-37999463a1ce None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:18.301448 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c1276-ca4e-497a-80e3-f089dde002fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:18.302356 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c1276-ca4e-497a-80e3-f089dde002fd None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:18.302815 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c1276-ca4e-497a-80e3-f089dde002fd None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:18.303010 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e34457-f5d9-46fe-904d-c7a6fcdcd785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:18.303417 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c1276-ca4e-497a-80e3-f089dde002fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:18.303842 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e34457-f5d9-46fe-904d-c7a6fcdcd785 None admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:18.304292 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e34457-f5d9-46fe-904d-c7a6fcdcd785 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:18.304753 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e34457-f5d9-46fe-904d-c7a6fcdcd785 None admin] PATH_INFO: `/v3/projects/8969ed754fe24784a2025cbdbf6f1a8b/users/507ae56497684fc08f05c65a3c23e898/roles/53b761158f744776b470f11e00bdaa81` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:18.311550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c1276-ca4e-497a-80e3-f089dde002fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:18.313181 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c1276-ca4e-497a-80e3-f089dde002fd None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:18.321850 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e34457-f5d9-46fe-904d-c7a6fcdcd785 None admin] RBAC: Authorizing `identity:create_grant(project_id=8969ed754fe24784a2025cbdbf6f1a8b, user_id=507ae56497684fc08f05c65a3c23e898, role_id=53b761158f744776b470f11e00bdaa81)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:18.323426 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e34457-f5d9-46fe-904d-c7a6fcdcd785 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:18.325759 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-b89c1276-ca4e-497a-80e3-f089dde002fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:18.325759 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:18.325759 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:18.325759 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:18.325759 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:18.325759 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:18.325759 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:18.325759 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:18.325759 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:18.325759 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:18.325759 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:18.325759 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:18.325759 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:43:18.325759 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:43:18.325759 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:43:18.326731 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:43:18.326731 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:18.326731 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:18.326731 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:18.326731 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:18.326731 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:18.326731 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:18.326731 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:18.326731 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:18.326731 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:18.326731 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:18.326731 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:18.326731 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:18.326731 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:18.326731 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:18.326731 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:18.326731 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:18.327589 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:43:18.327589 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:43:18.327589 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:43:18.327589 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:43:18.327589 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:43:18.327589 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:43:18.327589 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:18.327589 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:18.329631 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 212/413] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:43:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:18.330831 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c1276-ca4e-497a-80e3-f089dde002fd None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:18.341054 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 202/414] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Oct 30 00:43:18 2022] PUT /identity/v3/projects/8969ed754fe24784a2025cbdbf6f1a8b/users/507ae56497684fc08f05c65a3c23e898/roles/53b761158f744776b470f11e00bdaa81 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:43:18.342104 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e34457-f5d9-46fe-904d-c7a6fcdcd785 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:18.372345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:18.384816 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:18.452701 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c1276-ca4e-497a-80e3-f089dde002fd None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:18.468792 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e34457-f5d9-46fe-904d-c7a6fcdcd785 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:18.491884 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822c5d3-3080-4a7c-a655-ffb41f621033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:18.493389 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822c5d3-3080-4a7c-a655-ffb41f621033 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:18.493873 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822c5d3-3080-4a7c-a655-ffb41f621033 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:18.494345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822c5d3-3080-4a7c-a655-ffb41f621033 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:18.495413 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822c5d3-3080-4a7c-a655-ffb41f621033 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:18.496044 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822c5d3-3080-4a7c-a655-ffb41f621033 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:18.497937 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822c5d3-3080-4a7c-a655-ffb41f621033 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:18.508578 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd2dd3-3b00-4aad-bc91-aa762ee3aea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:18.508986 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd2dd3-3b00-4aad-bc91-aa762ee3aea1 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:18.509307 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd2dd3-3b00-4aad-bc91-aa762ee3aea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:18.509581 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd2dd3-3b00-4aad-bc91-aa762ee3aea1 None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:18.510324 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd2dd3-3b00-4aad-bc91-aa762ee3aea1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:18.510721 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd2dd3-3b00-4aad-bc91-aa762ee3aea1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:18.512696 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd2dd3-3b00-4aad-bc91-aa762ee3aea1 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:18.514188 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 213/415] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Oct 30 00:43:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:18.520170 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822c5d3-3080-4a7c-a655-ffb41f621033 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:18.532485 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 203/416] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Oct 30 00:43:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:18.538294 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd2dd3-3b00-4aad-bc91-aa762ee3aea1 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:18.680661 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:18.687784 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822c5d3-3080-4a7c-a655-ffb41f621033 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:18.688842 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:18.699922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd2dd3-3b00-4aad-bc91-aa762ee3aea1 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:18.735553 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbad85-9985-4c0e-ae6a-2a2ac8893196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:18.736204 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbad85-9985-4c0e-ae6a-2a2ac8893196 None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:18.736483 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbad85-9985-4c0e-ae6a-2a2ac8893196 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:18.736752 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbad85-9985-4c0e-ae6a-2a2ac8893196 None admin] PATH_INFO: `/v3/projects/8969ed754fe24784a2025cbdbf6f1a8b/users/0dfd57a56ebe41ebb2b836d1ab03e334/roles/53b761158f744776b470f11e00bdaa81` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:18.751766 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a27ae-644f-428d-aa04-6d6e94b7486b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:18.752998 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a27ae-644f-428d-aa04-6d6e94b7486b None admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:18.753450 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a27ae-644f-428d-aa04-6d6e94b7486b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:18.753885 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a27ae-644f-428d-aa04-6d6e94b7486b None admin] PATH_INFO: `/v3/projects/8969ed754fe24784a2025cbdbf6f1a8b/users/93b5c95d6fd64262849f4c09fe0a716f/roles/53b761158f744776b470f11e00bdaa81` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:18.756239 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbbad85-9985-4c0e-ae6a-2a2ac8893196 None admin] RBAC: Authorizing `identity:create_grant(project_id=8969ed754fe24784a2025cbdbf6f1a8b, user_id=0dfd57a56ebe41ebb2b836d1ab03e334, role_id=53b761158f744776b470f11e00bdaa81)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:18.757741 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbbad85-9985-4c0e-ae6a-2a2ac8893196 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:18.772475 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a27ae-644f-428d-aa04-6d6e94b7486b None admin] RBAC: Authorizing `identity:create_grant(project_id=8969ed754fe24784a2025cbdbf6f1a8b, user_id=93b5c95d6fd64262849f4c09fe0a716f, role_id=53b761158f744776b470f11e00bdaa81)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:18.774870 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a27ae-644f-428d-aa04-6d6e94b7486b None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:18.776703 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 214/417] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Oct 30 00:43:18 2022] PUT /identity/v3/projects/8969ed754fe24784a2025cbdbf6f1a8b/users/0dfd57a56ebe41ebb2b836d1ab03e334/roles/53b761158f744776b470f11e00bdaa81 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:43:18.794260 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 204/418] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Oct 30 00:43:18 2022] PUT /identity/v3/projects/8969ed754fe24784a2025cbdbf6f1a8b/users/93b5c95d6fd64262849f4c09fe0a716f/roles/53b761158f744776b470f11e00bdaa81 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:43:19.251500 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a281f0-9610-45ca-91d7-18ced53f7b8a None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:19.251992 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a281f0-9610-45ca-91d7-18ced53f7b8a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:19.252373 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a281f0-9610-45ca-91d7-18ced53f7b8a None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:19.254070 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 215/419] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:19.259789 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15f9d2-aa5a-4e3b-83ab-ea0a47bdd84a None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:19.260184 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15f9d2-aa5a-4e3b-83ab-ea0a47bdd84a None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:19.260570 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15f9d2-aa5a-4e3b-83ab-ea0a47bdd84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:19.290189 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-8f15f9d2-aa5a-4e3b-83ab-ea0a47bdd84a None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:19.291534 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8f15f9d2-aa5a-4e3b-83ab-ea0a47bdd84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:19.383740 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 205/420] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:43:19.718691 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a281f0-9610-45ca-91d7-18ced53f7b8a None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:19.864845 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a281f0-9610-45ca-91d7-18ced53f7b8a None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:19.912515 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f6e2f-7b73-40ab-a89d-7d3f586882a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:19.913511 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f6e2f-7b73-40ab-a89d-7d3f586882a3 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:19.913981 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f6e2f-7b73-40ab-a89d-7d3f586882a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:19.914435 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f6e2f-7b73-40ab-a89d-7d3f586882a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:19.925458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f6e2f-7b73-40ab-a89d-7d3f586882a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:43:19.930371 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-c90f6e2f-7b73-40ab-a89d-7d3f586882a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:43:19.930371 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:19.930371 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:19.930371 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:19.930371 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:19.930371 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:19.930371 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:19.930371 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:19.930371 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:19.930371 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:19.930371 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:19.930371 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:19.930371 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:43:19.930371 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:43:19.930371 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:43:19.930371 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:43:19.931227 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:43:19.931227 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:43:19.931227 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:43:19.931227 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:43:19.931227 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:19.931227 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:19.931227 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:19.931227 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:19.931227 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:19.931227 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:19.931227 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:19.931227 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:19.931227 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:19.931227 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:19.931227 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:19.931227 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:19.932040 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:19.932040 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:19.932040 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:19.932040 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:19.932040 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:43:19.932040 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:43:19.932040 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:43:19.932040 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:43:19.932040 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:43:19.932040 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:43:19.932040 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:43:19.932040 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:19.935121 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 216/421] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Oct 30 00:43:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:19.940966 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15f9d2-aa5a-4e3b-83ab-ea0a47bdd84a None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:20.023667 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:20.068863 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15f9d2-aa5a-4e3b-83ab-ea0a47bdd84a None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:20.117473 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7866bdc-ac6a-4acd-9456-4f7dbe20548c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:20.118072 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7866bdc-ac6a-4acd-9456-4f7dbe20548c None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:20.118346 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7866bdc-ac6a-4acd-9456-4f7dbe20548c None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:20.118614 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7866bdc-ac6a-4acd-9456-4f7dbe20548c None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:20.119345 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7866bdc-ac6a-4acd-9456-4f7dbe20548c None admin] RBAC: Adding query filter params (name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:20.119646 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7866bdc-ac6a-4acd-9456-4f7dbe20548c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:20.121059 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7866bdc-ac6a-4acd-9456-4f7dbe20548c None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:20.135444 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 206/422] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Oct 30 00:43:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:20.141818 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f6e2f-7b73-40ab-a89d-7d3f586882a3 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:20.159188 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:20.197482 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80840bcc-6ec5-4aaa-8a32-12a1440708b9 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:20.198068 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80840bcc-6ec5-4aaa-8a32-12a1440708b9 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:20.198540 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80840bcc-6ec5-4aaa-8a32-12a1440708b9 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:20.201002 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 207/423] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:43:20.206211 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d62feb-9222-48a1-92f0-b2de5eb95d5e None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:20.206857 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d62feb-9222-48a1-92f0-b2de5eb95d5e None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:20.207348 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d62feb-9222-48a1-92f0-b2de5eb95d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:20.226129 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-95d62feb-9222-48a1-92f0-b2de5eb95d5e None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:20.227582 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-95d62feb-9222-48a1-92f0-b2de5eb95d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:20.325719 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 208/424] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:43:20.337365 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f6e2f-7b73-40ab-a89d-7d3f586882a3 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:20.372115 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ccd70-d844-4696-8ff9-9b4cdaccb281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:20.372783 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ccd70-d844-4696-8ff9-9b4cdaccb281 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:20.373065 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ccd70-d844-4696-8ff9-9b4cdaccb281 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:20.373364 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ccd70-d844-4696-8ff9-9b4cdaccb281 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:20.383902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ccd70-d844-4696-8ff9-9b4cdaccb281 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:20.385377 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ccd70-d844-4696-8ff9-9b4cdaccb281 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:20.401040 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-ba8ccd70-d844-4696-8ff9-9b4cdaccb281 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:20.401040 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:20.401040 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:20.401040 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:20.401040 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:20.401040 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:20.401040 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:20.401040 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:20.401040 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:20.401040 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:20.401040 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:20.401040 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:20.401040 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:20.401040 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:20.401040 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:20.401040 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:20.402002 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:20.402002 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:20.402002 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:20.402002 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:20.402002 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:20.402002 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:20.402002 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:20.402002 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:20.402002 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:20.402002 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:20.402002 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:20.402002 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:20.402002 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:20.402002 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:20.402002 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:20.402002 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:20.402002 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:20.402894 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:20.402894 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:20.402894 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:20.402894 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 217/425] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:20.410274 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d62feb-9222-48a1-92f0-b2de5eb95d5e None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:20.486816 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:20.538719 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d62feb-9222-48a1-92f0-b2de5eb95d5e None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:20.585928 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0baa09-2d08-4cb8-8fc6-c184d2948b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:20.586535 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0baa09-2d08-4cb8-8fc6-c184d2948b62 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:20.586811 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0baa09-2d08-4cb8-8fc6-c184d2948b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:20.587076 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0baa09-2d08-4cb8-8fc6-c184d2948b62 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:20.587712 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0baa09-2d08-4cb8-8fc6-c184d2948b62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:20.588008 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0baa09-2d08-4cb8-8fc6-c184d2948b62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:20.589394 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0baa09-2d08-4cb8-8fc6-c184d2948b62 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:20.603496 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 209/426] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:20.609658 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ccd70-d844-4696-8ff9-9b4cdaccb281 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:20.675515 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:20.685577 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0baa09-2d08-4cb8-8fc6-c184d2948b62 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:20.724915 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ccd70-d844-4696-8ff9-9b4cdaccb281 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:20.766578 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac110d2-bc18-4c7b-b11d-3daa57563a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:20.767566 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac110d2-bc18-4c7b-b11d-3daa57563a75 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:20.768074 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac110d2-bc18-4c7b-b11d-3daa57563a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:20.768545 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac110d2-bc18-4c7b-b11d-3daa57563a75 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:20.778378 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac110d2-bc18-4c7b-b11d-3daa57563a75 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:20.780425 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac110d2-bc18-4c7b-b11d-3daa57563a75 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:20.796180 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-eac110d2-bc18-4c7b-b11d-3daa57563a75 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:43:20.796180 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:20.796180 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:20.796180 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:20.796180 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:20.796180 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:20.796180 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:20.796180 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:20.796180 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:20.796180 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:20.796180 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:20.796180 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:20.796180 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:43:20.796180 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:43:20.796180 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:43:20.796180 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:43:20.797119 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:20.797119 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:20.797119 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:43:20.797119 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:20.797119 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:43:20.797119 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:20.797119 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:20.797119 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:20.797119 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:20.797119 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:20.797119 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:20.797119 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:20.797119 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:20.797119 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:20.797119 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:20.797119 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:20.797119 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:20.797119 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:20.798058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:20.798058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:20.798058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:43:20.798058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:43:20.798058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:43:20.798058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:43:20.798058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:43:20.798058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:43:20.798058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:43:20.798058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:20.801038 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 218/427] 10.222.0.40 () {56 vars in 1093 bytes} [Sun Oct 30 00:43:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:20.806480 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac110d2-bc18-4c7b-b11d-3daa57563a75 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:20.892582 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0baa09-2d08-4cb8-8fc6-c184d2948b62 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:20.921987 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:20.935240 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426e1c5-dadc-4fd2-95b1-b01bfa8d9ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:20.936183 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426e1c5-dadc-4fd2-95b1-b01bfa8d9ded None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:20.936665 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426e1c5-dadc-4fd2-95b1-b01bfa8d9ded None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:20.937159 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426e1c5-dadc-4fd2-95b1-b01bfa8d9ded None admin] PATH_INFO: `/v3/roles/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:20.947997 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426e1c5-dadc-4fd2-95b1-b01bfa8d9ded None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:43:20.954918 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-7426e1c5-dadc-4fd2-95b1-b01bfa8d9ded None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:43:20.954918 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:20.954918 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:20.954918 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:20.954918 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:20.954918 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:20.954918 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:20.954918 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:20.954918 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:20.954918 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:20.954918 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:20.954918 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:20.954918 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:43:20.954918 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:43:20.954918 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:43:20.954918 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:43:20.955838 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:43:20.955838 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:43:20.955838 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:43:20.955838 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:43:20.955838 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:20.955838 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:20.955838 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:20.955838 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:20.955838 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:20.955838 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:20.955838 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:20.955838 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:20.955838 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:20.955838 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:20.955838 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:20.955838 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:20.956644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:20.956644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:20.956644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:20.956644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:20.956644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:43:20.956644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:43:20.956644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:43:20.956644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:43:20.956644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:43:20.956644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:43:20.956644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:43:20.956644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:20.959209 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 210/428] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Oct 30 00:43:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:43:20.966391 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426e1c5-dadc-4fd2-95b1-b01bfa8d9ded None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:20.992112 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac110d2-bc18-4c7b-b11d-3daa57563a75 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:21.005667 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:21.019749 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee773f-af78-4ec2-9503-c2d482a17662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:21.020269 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee773f-af78-4ec2-9503-c2d482a17662 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:21.020541 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee773f-af78-4ec2-9503-c2d482a17662 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:21.020805 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee773f-af78-4ec2-9503-c2d482a17662 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:21.021578 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee773f-af78-4ec2-9503-c2d482a17662 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:21.021877 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee773f-af78-4ec2-9503-c2d482a17662 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:21.023329 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee773f-af78-4ec2-9503-c2d482a17662 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:21.042466 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 219/429] 10.222.0.40 () {56 vars in 1133 bytes} [Sun Oct 30 00:43:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:43:21.046488 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8990d2-e565-43c0-bcb4-eb9173fa2b48 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:21.046771 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8990d2-e565-43c0-bcb4-eb9173fa2b48 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:21.047103 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8990d2-e565-43c0-bcb4-eb9173fa2b48 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:21.048237 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 220/430] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:21.051672 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8990d2-e565-43c0-bcb4-eb9173fa2b48 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:21.091583 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426e1c5-dadc-4fd2-95b1-b01bfa8d9ded None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:21.128099 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d3ca4-d60c-484c-9342-52962a435fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:21.129070 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d3ca4-d60c-484c-9342-52962a435fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:21.129573 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d3ca4-d60c-484c-9342-52962a435fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:21.130063 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d3ca4-d60c-484c-9342-52962a435fb5 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:21.130915 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d3ca4-d60c-484c-9342-52962a435fb5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:21.131430 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d3ca4-d60c-484c-9342-52962a435fb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:21.133005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d3ca4-d60c-484c-9342-52962a435fb5 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:21.146522 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 211/431] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Oct 30 00:43:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:21.148097 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858faacf-cd67-4f6d-8f97-c7d757b08b45 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:21.148609 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858faacf-cd67-4f6d-8f97-c7d757b08b45 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:21.149359 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858faacf-cd67-4f6d-8f97-c7d757b08b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:21.156821 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8990d2-e565-43c0-bcb4-eb9173fa2b48 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:21.169248 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-858faacf-cd67-4f6d-8f97-c7d757b08b45 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:21.170755 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-858faacf-cd67-4f6d-8f97-c7d757b08b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:21.192446 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70774a65-f488-4362-98ba-03c755cdfa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:21.193094 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70774a65-f488-4362-98ba-03c755cdfa76 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:21.193412 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70774a65-f488-4362-98ba-03c755cdfa76 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:21.193678 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70774a65-f488-4362-98ba-03c755cdfa76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:21.218163 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:21.241716 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:21.246965 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 212/432] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:43:21.248132 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858faacf-cd67-4f6d-8f97-c7d757b08b45 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:21.272784 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70774a65-f488-4362-98ba-03c755cdfa76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:21.274657 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70774a65-f488-4362-98ba-03c755cdfa76 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:21.403318 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858faacf-cd67-4f6d-8f97-c7d757b08b45 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:21.440503 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336c770-7152-466f-98e9-e278b00dd9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:21.441559 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336c770-7152-466f-98e9-e278b00dd9c3 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:21.442039 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336c770-7152-466f-98e9-e278b00dd9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:21.442510 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336c770-7152-466f-98e9-e278b00dd9c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:21.455407 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d336c770-7152-466f-98e9-e278b00dd9c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:21.457272 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d336c770-7152-466f-98e9-e278b00dd9c3 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:21.474863 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-d336c770-7152-466f-98e9-e278b00dd9c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:21.474863 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:21.474863 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:21.474863 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:21.474863 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:21.474863 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:21.474863 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:21.474863 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:21.474863 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:21.474863 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:21.474863 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:21.474863 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:21.474863 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:21.474863 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:21.474863 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:21.474863 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:21.475844 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:21.475844 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:21.475844 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:21.475844 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:21.475844 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:21.475844 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:21.475844 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:21.475844 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:21.475844 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:21.475844 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:21.475844 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:21.475844 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:21.475844 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:21.475844 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:21.475844 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:21.475844 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:21.475844 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:21.476698 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:21.476698 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:21.476698 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:21.478505 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 213/433] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:21.484104 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336c770-7152-466f-98e9-e278b00dd9c3 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:21.489840 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 221/434] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Oct 30 00:43:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 30 00:43:21.494814 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70774a65-f488-4362-98ba-03c755cdfa76 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:21.515515 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:21.592783 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336c770-7152-466f-98e9-e278b00dd9c3 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:21.622271 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:21.631440 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19006557-5aba-4191-8d08-15e8d7f78bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:21.632056 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19006557-5aba-4191-8d08-15e8d7f78bbf None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:21.632332 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19006557-5aba-4191-8d08-15e8d7f78bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:21.632600 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19006557-5aba-4191-8d08-15e8d7f78bbf None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:21.633272 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19006557-5aba-4191-8d08-15e8d7f78bbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:21.633573 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19006557-5aba-4191-8d08-15e8d7f78bbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:21.634981 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19006557-5aba-4191-8d08-15e8d7f78bbf None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:21.649277 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 214/435] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:43:21.650336 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b00872-2a36-4f2c-bfbb-ec4d2efb3ad3 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:21.650624 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b00872-2a36-4f2c-bfbb-ec4d2efb3ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:21.650936 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b00872-2a36-4f2c-bfbb-ec4d2efb3ad3 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:21.656670 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 215/436] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:21.656670 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b00872-2a36-4f2c-bfbb-ec4d2efb3ad3 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:21.657525 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70774a65-f488-4362-98ba-03c755cdfa76 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:21.692611 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601480b7-4950-4614-ba7a-50f54bfc6fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:21.693288 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601480b7-4950-4614-ba7a-50f54bfc6fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:21.693567 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601480b7-4950-4614-ba7a-50f54bfc6fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:21.693984 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601480b7-4950-4614-ba7a-50f54bfc6fe3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:21.705165 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601480b7-4950-4614-ba7a-50f54bfc6fe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:21.706623 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601480b7-4950-4614-ba7a-50f54bfc6fe3 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:21.721952 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-601480b7-4950-4614-ba7a-50f54bfc6fe3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:21.721952 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:21.721952 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:21.721952 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:21.721952 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:21.721952 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:21.721952 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:21.721952 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:21.721952 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:21.721952 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:21.721952 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:21.721952 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:21.721952 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:21.721952 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:21.721952 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:21.721952 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:21.722879 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:21.722879 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:21.722879 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:21.722879 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:21.722879 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:21.722879 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:21.722879 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:21.722879 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:21.722879 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:21.722879 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:21.722879 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:21.722879 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:21.722879 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:21.722879 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:21.722879 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:21.722879 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:21.722879 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:21.723711 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:21.723711 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:21.723711 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:21.723711 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 222/437] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:21.723928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601480b7-4950-4614-ba7a-50f54bfc6fe3 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:21.756859 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:21.770008 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b00872-2a36-4f2c-bfbb-ec4d2efb3ad3 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:21.803270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119baa91-a5bf-4dc7-84f3-0b1992e66693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:21.803901 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119baa91-a5bf-4dc7-84f3-0b1992e66693 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:21.804170 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119baa91-a5bf-4dc7-84f3-0b1992e66693 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:21.804432 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119baa91-a5bf-4dc7-84f3-0b1992e66693 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:21.814495 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119baa91-a5bf-4dc7-84f3-0b1992e66693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:43:21.819132 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-119baa91-a5bf-4dc7-84f3-0b1992e66693 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:43:21.819132 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:21.819132 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:21.819132 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:21.819132 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:21.819132 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:21.819132 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:21.819132 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:21.819132 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:21.819132 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:21.819132 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:21.819132 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:21.819132 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:43:21.819132 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:43:21.819132 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:43:21.819132 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:43:21.820200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:43:21.820200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:43:21.820200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:43:21.820200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:43:21.820200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:21.820200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:21.820200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:21.820200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:21.820200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:21.820200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:21.820200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:21.820200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:21.820200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:21.820200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:21.820200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:21.820200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:21.821010 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:21.821010 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:21.821010 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:21.821010 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:21.821010 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:43:21.821010 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:43:21.821010 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:43:21.821010 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:43:21.821010 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:43:21.821010 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:43:21.821010 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:43:21.821010 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:21.821010 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 216/438] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Oct 30 00:43:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:21.821724 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89932d97-f776-48c7-bddb-fc9e61a3abdd None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:21.821724 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89932d97-f776-48c7-bddb-fc9e61a3abdd None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:21.821850 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89932d97-f776-48c7-bddb-fc9e61a3abdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:21.827511 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601480b7-4950-4614-ba7a-50f54bfc6fe3 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:21.840184 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-89932d97-f776-48c7-bddb-fc9e61a3abdd None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:21.841388 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-89932d97-f776-48c7-bddb-fc9e61a3abdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:21.853303 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:21.861530 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f8908-b073-4c59-9ca4-80b98b2ce1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:21.862143 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f8908-b073-4c59-9ca4-80b98b2ce1db None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:21.862421 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f8908-b073-4c59-9ca4-80b98b2ce1db None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:21.862688 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f8908-b073-4c59-9ca4-80b98b2ce1db None admin] PATH_INFO: `/v3/users/swift` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:21.870022 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f8908-b073-4c59-9ca4-80b98b2ce1db None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:21.871968 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f8908-b073-4c59-9ca4-80b98b2ce1db None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:21.882804 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-7f5f8908-b073-4c59-9ca4-80b98b2ce1db None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 30 00:43:21.882804 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:21.882804 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:21.882804 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:21.882804 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:21.882804 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:21.882804 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:21.882804 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:21.882804 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:21.882804 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:21.882804 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:21.882804 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:21.882804 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:43:21.882804 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:43:21.882804 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:43:21.882804 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:43:21.883905 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:21.883905 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:21.883905 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:43:21.883905 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:21.883905 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:43:21.883905 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:21.883905 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:21.883905 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:21.883905 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:21.883905 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:21.883905 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:21.883905 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:21.883905 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:21.883905 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:21.883905 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:21.883905 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:21.883905 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:21.883905 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:21.884837 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:21.884837 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:21.884837 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:43:21.884837 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:43:21.884837 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:43:21.884837 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:43:21.884837 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:43:21.884837 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:43:21.884837 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 30 00:43:21.884837 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:21.884837 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 223/439] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Oct 30 00:43:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:21.885445 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c3ce7-2d02-4fdd-ac96-fdbcb2f602da None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:21.885445 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c3ce7-2d02-4fdd-ac96-fdbcb2f602da None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:21.885571 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c3ce7-2d02-4fdd-ac96-fdbcb2f602da None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:21.887517 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 224/440] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:21.888218 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c3ce7-2d02-4fdd-ac96-fdbcb2f602da None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:21.911301 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 217/441] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:43:21.912123 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89932d97-f776-48c7-bddb-fc9e61a3abdd None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:21.995425 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c3ce7-2d02-4fdd-ac96-fdbcb2f602da None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:21.997176 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:22.021531 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89932d97-f776-48c7-bddb-fc9e61a3abdd None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:22.029291 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399bdfc-8a6c-41b6-9368-e60342fce641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:22.029886 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399bdfc-8a6c-41b6-9368-e60342fce641 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:22.030165 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399bdfc-8a6c-41b6-9368-e60342fce641 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:22.030430 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399bdfc-8a6c-41b6-9368-e60342fce641 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:22.031056 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399bdfc-8a6c-41b6-9368-e60342fce641 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:22.031349 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399bdfc-8a6c-41b6-9368-e60342fce641 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:22.032695 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399bdfc-8a6c-41b6-9368-e60342fce641 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:22.043881 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 225/442] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:22.044656 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399bdfc-8a6c-41b6-9368-e60342fce641 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:22.063935 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542ae03-ca7f-49dc-9e96-157096edee23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:22.064780 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542ae03-ca7f-49dc-9e96-157096edee23 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:22.065230 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542ae03-ca7f-49dc-9e96-157096edee23 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:22.065644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542ae03-ca7f-49dc-9e96-157096edee23 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:22.066527 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542ae03-ca7f-49dc-9e96-157096edee23 None admin] RBAC: Adding query filter params (name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:22.067084 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542ae03-ca7f-49dc-9e96-157096edee23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:22.068437 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542ae03-ca7f-49dc-9e96-157096edee23 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:22.081536 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 218/443] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Oct 30 00:43:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:22.081536 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d5955-2929-4d51-a81f-126256f06d25 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:22.081536 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d5955-2929-4d51-a81f-126256f06d25 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:22.081536 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d5955-2929-4d51-a81f-126256f06d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:22.097334 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-416d5955-2929-4d51-a81f-126256f06d25 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:22.098184 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:22.098662 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-416d5955-2929-4d51-a81f-126256f06d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:22.149493 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399bdfc-8a6c-41b6-9368-e60342fce641 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:22.177223 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 219/444] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:43:22.177223 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d5955-2929-4d51-a81f-126256f06d25 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:22.191927 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c45c7f-816c-4a7b-a8bf-29a971f544ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:22.192606 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c45c7f-816c-4a7b-a8bf-29a971f544ef None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:22.192888 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c45c7f-816c-4a7b-a8bf-29a971f544ef None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:22.193159 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c45c7f-816c-4a7b-a8bf-29a971f544ef None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:22.193907 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c45c7f-816c-4a7b-a8bf-29a971f544ef None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:22.194207 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c45c7f-816c-4a7b-a8bf-29a971f544ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:22.195627 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c45c7f-816c-4a7b-a8bf-29a971f544ef None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:22.213262 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 226/445] 10.222.0.40 () {56 vars in 1135 bytes} [Sun Oct 30 00:43:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:22.214106 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c45c7f-816c-4a7b-a8bf-29a971f544ef None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:22.246717 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:22.287208 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d5955-2929-4d51-a81f-126256f06d25 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:22.316674 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c45c7f-816c-4a7b-a8bf-29a971f544ef None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:22.322324 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84803a-49d5-44e2-86c9-b7f925ffe0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:22.322945 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84803a-49d5-44e2-86c9-b7f925ffe0f7 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:22.323212 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84803a-49d5-44e2-86c9-b7f925ffe0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:22.323475 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84803a-49d5-44e2-86c9-b7f925ffe0f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:22.324604 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:22.330548 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84803a-49d5-44e2-86c9-b7f925ffe0f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:22.331962 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84803a-49d5-44e2-86c9-b7f925ffe0f7 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:22.344886 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-ca84803a-49d5-44e2-86c9-b7f925ffe0f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:22.344886 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:22.344886 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:22.344886 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:22.344886 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:22.344886 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:22.344886 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:22.344886 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:22.344886 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:22.344886 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:22.344886 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:22.344886 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:22.344886 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:43:22.344886 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:43:22.344886 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:43:22.346169 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:43:22.346169 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:22.346169 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:22.346169 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:22.346169 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:22.346169 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:22.346169 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:22.346169 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:22.346169 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:22.346169 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:22.346169 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:22.346169 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:22.346169 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:22.346169 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:22.346169 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:22.346169 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:22.346169 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:22.347022 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:43:22.347022 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:43:22.347022 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:43:22.347022 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:43:22.347022 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:43:22.347022 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:43:22.347022 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:22.347022 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:22.350610 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 220/446] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:43:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:22.351437 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84803a-49d5-44e2-86c9-b7f925ffe0f7 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:22.355398 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c339b-c21f-4bf9-aa68-793d5bdfa142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:22.356556 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c339b-c21f-4bf9-aa68-793d5bdfa142 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:22.356835 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c339b-c21f-4bf9-aa68-793d5bdfa142 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:22.357104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c339b-c21f-4bf9-aa68-793d5bdfa142 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:22.367365 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c339b-c21f-4bf9-aa68-793d5bdfa142 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:22.368819 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c339b-c21f-4bf9-aa68-793d5bdfa142 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:22.384104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-fb8c339b-c21f-4bf9-aa68-793d5bdfa142 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:22.384104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:22.384104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:22.384104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:22.384104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:22.384104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:22.384104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:22.384104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:22.384104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:22.384104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:22.384104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:22.384104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:22.384104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:22.384104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:22.384104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:22.384104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:22.385174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:22.385174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:22.385174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:22.385174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:22.385174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:22.385174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:22.385174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:22.385174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:22.385174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:22.385174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:22.385174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:22.385174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:22.385174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:22.385174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:22.385174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:22.385174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:22.385174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:22.386193 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:22.386193 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:22.386193 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:22.389792 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 227/447] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:22.390484 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c339b-c21f-4bf9-aa68-793d5bdfa142 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:22.460787 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84803a-49d5-44e2-86c9-b7f925ffe0f7 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:22.489495 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:22.490470 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c339b-c21f-4bf9-aa68-793d5bdfa142 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:22.495690 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225842e-01d6-40cd-b750-cafb7180f897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:22.496328 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225842e-01d6-40cd-b750-cafb7180f897 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:22.496597 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225842e-01d6-40cd-b750-cafb7180f897 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:22.496864 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225842e-01d6-40cd-b750-cafb7180f897 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:22.507053 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225842e-01d6-40cd-b750-cafb7180f897 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:43:22.512938 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-8225842e-01d6-40cd-b750-cafb7180f897 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:43:22.512938 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:22.512938 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:22.512938 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:22.512938 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:22.512938 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:22.512938 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:22.512938 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:22.512938 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:22.512938 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:22.512938 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:22.512938 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:22.512938 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:43:22.512938 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:43:22.512938 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:43:22.512938 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:43:22.514064 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:43:22.514064 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:43:22.514064 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:43:22.514064 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:43:22.514064 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:22.514064 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:22.514064 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:22.514064 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:22.514064 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:22.514064 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:22.514064 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:22.514064 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:22.514064 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:22.514064 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:22.514064 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:22.514064 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:22.514864 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:22.514864 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:22.514864 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:22.514864 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:22.514864 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:43:22.514864 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:43:22.514864 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:43:22.514864 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:43:22.514864 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:43:22.514864 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:43:22.514864 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:43:22.514864 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:22.514864 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 221/448] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Oct 30 00:43:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:22.514864 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225842e-01d6-40cd-b750-cafb7180f897 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:22.530387 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81638d95-3652-4b51-a1a0-8c41307171a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:22.531001 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81638d95-3652-4b51-a1a0-8c41307171a5 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:22.531275 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81638d95-3652-4b51-a1a0-8c41307171a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:22.531541 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81638d95-3652-4b51-a1a0-8c41307171a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:22.542643 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81638d95-3652-4b51-a1a0-8c41307171a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:22.544976 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81638d95-3652-4b51-a1a0-8c41307171a5 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:22.559188 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-81638d95-3652-4b51-a1a0-8c41307171a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:22.559188 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:22.559188 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:22.559188 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:22.559188 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:22.559188 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:22.559188 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:22.559188 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:22.559188 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:22.559188 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:22.559188 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:22.559188 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:22.559188 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:22.559188 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:22.559188 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:22.559188 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:22.560125 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:22.560125 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:22.560125 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:22.560125 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:22.560125 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:22.560125 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:22.560125 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:22.560125 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:22.560125 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:22.560125 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:22.560125 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:22.560125 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:22.560125 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:22.560125 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:22.560125 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:22.560125 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:22.560125 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:22.560975 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:22.560975 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:22.560975 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:22.560975 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 228/449] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:22.561408 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81638d95-3652-4b51-a1a0-8c41307171a5 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:22.576347 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:22.614320 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225842e-01d6-40cd-b750-cafb7180f897 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:22.646506 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f54050-1435-45f9-b6df-c676c10947b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:22.647282 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f54050-1435-45f9-b6df-c676c10947b4 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:22.647552 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f54050-1435-45f9-b6df-c676c10947b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:22.647811 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f54050-1435-45f9-b6df-c676c10947b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:22.648476 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f54050-1435-45f9-b6df-c676c10947b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:22.648768 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f54050-1435-45f9-b6df-c676c10947b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:22.650489 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f54050-1435-45f9-b6df-c676c10947b4 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:22.662321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81638d95-3652-4b51-a1a0-8c41307171a5 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:22.667603 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 222/450] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Oct 30 00:43:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:22.668564 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f54050-1435-45f9-b6df-c676c10947b4 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:22.697718 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23ad5b-b097-4e1a-bbe0-e473e45e1e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:22.698351 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23ad5b-b097-4e1a-bbe0-e473e45e1e56 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:22.698613 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23ad5b-b097-4e1a-bbe0-e473e45e1e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:22.698885 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23ad5b-b097-4e1a-bbe0-e473e45e1e56 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:22.699582 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23ad5b-b097-4e1a-bbe0-e473e45e1e56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:22.699877 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23ad5b-b097-4e1a-bbe0-e473e45e1e56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:22.701261 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23ad5b-b097-4e1a-bbe0-e473e45e1e56 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:22.712465 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 229/451] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:22.713176 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23ad5b-b097-4e1a-bbe0-e473e45e1e56 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:22.717937 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:22.766718 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f54050-1435-45f9-b6df-c676c10947b4 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:22.781936 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:22.799358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e197a03-8e61-48f1-bd3f-9a5e3a0683b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:22.799968 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e197a03-8e61-48f1-bd3f-9a5e3a0683b4 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:22.800245 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e197a03-8e61-48f1-bd3f-9a5e3a0683b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:22.800516 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e197a03-8e61-48f1-bd3f-9a5e3a0683b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:22.810751 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e197a03-8e61-48f1-bd3f-9a5e3a0683b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:43:22.811838 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23ad5b-b097-4e1a-bbe0-e473e45e1e56 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:22.815478 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-3e197a03-8e61-48f1-bd3f-9a5e3a0683b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:43:22.815478 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:22.815478 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:22.815478 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:22.815478 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:22.815478 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:22.815478 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:22.815478 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:22.815478 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:22.815478 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:22.815478 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:22.815478 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:22.815478 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:43:22.815478 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:43:22.815478 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:43:22.815478 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:43:22.816336 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:43:22.816336 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:43:22.816336 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:43:22.816336 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:43:22.816336 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:22.816336 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:22.816336 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:22.816336 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:22.816336 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:22.816336 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:22.816336 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:22.816336 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:22.816336 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:22.816336 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:22.816336 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:22.816336 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:22.817143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:22.817143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:22.817143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:22.817143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:22.817143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:43:22.817143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:43:22.817143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:43:22.817143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:43:22.817143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:43:22.817143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:43:22.817143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:43:22.817143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:22.817143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 223/452] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Oct 30 00:43:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:22.818235 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e197a03-8e61-48f1-bd3f-9a5e3a0683b4 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:22.848496 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39a6b6-3588-4f7d-9e83-045870eb6d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:22.849092 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39a6b6-3588-4f7d-9e83-045870eb6d47 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:22.849398 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39a6b6-3588-4f7d-9e83-045870eb6d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:22.849667 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39a6b6-3588-4f7d-9e83-045870eb6d47 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:22.850307 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39a6b6-3588-4f7d-9e83-045870eb6d47 None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:22.850602 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39a6b6-3588-4f7d-9e83-045870eb6d47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:22.851957 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39a6b6-3588-4f7d-9e83-045870eb6d47 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:22.860889 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 230/453] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Oct 30 00:43:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:22.862058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39a6b6-3588-4f7d-9e83-045870eb6d47 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:22.921205 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e197a03-8e61-48f1-bd3f-9a5e3a0683b4 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:22.932043 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:22.955818 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed460ef-3731-4f80-9a2b-37c7c8d6f6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:22.956404 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed460ef-3731-4f80-9a2b-37c7c8d6f6e3 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:22.956671 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed460ef-3731-4f80-9a2b-37c7c8d6f6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:22.956936 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed460ef-3731-4f80-9a2b-37c7c8d6f6e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:22.957582 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed460ef-3731-4f80-9a2b-37c7c8d6f6e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:22.957873 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed460ef-3731-4f80-9a2b-37c7c8d6f6e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:22.959237 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed460ef-3731-4f80-9a2b-37c7c8d6f6e3 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:22.959618 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39a6b6-3588-4f7d-9e83-045870eb6d47 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:22.969993 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 224/454] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:22.970701 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed460ef-3731-4f80-9a2b-37c7c8d6f6e3 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:22.988754 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:22.993966 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffda4a0-891a-4639-a736-4aa4c00eb023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:22.994552 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffda4a0-891a-4639-a736-4aa4c00eb023 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:22.994823 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffda4a0-891a-4639-a736-4aa4c00eb023 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:22.995086 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffda4a0-891a-4639-a736-4aa4c00eb023 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:22.995784 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffda4a0-891a-4639-a736-4aa4c00eb023 None admin] RBAC: Adding query filter params (role.id=53b761158f744776b470f11e00bdaa81, scope.project.id=8969ed754fe24784a2025cbdbf6f1a8b, user.id=4237b425d9fa4a60b10802e5b108d542) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:22.996912 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffda4a0-891a-4639-a736-4aa4c00eb023 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:22.998355 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffda4a0-891a-4639-a736-4aa4c00eb023 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:23.003995 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 231/455] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Oct 30 00:43:22 2022] GET /identity/v3/role_assignments?user.id=4237b425d9fa4a60b10802e5b108d542&scope.project.id=8969ed754fe24784a2025cbdbf6f1a8b&role.id=53b761158f744776b470f11e00bdaa81 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:23.004666 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffda4a0-891a-4639-a736-4aa4c00eb023 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:23.087848 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed460ef-3731-4f80-9a2b-37c7c8d6f6e3 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:23.125869 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058b5b9-d098-4a55-81e9-4cdb92c811c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:23.126511 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058b5b9-d098-4a55-81e9-4cdb92c811c2 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:23.126775 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058b5b9-d098-4a55-81e9-4cdb92c811c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:23.127047 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058b5b9-d098-4a55-81e9-4cdb92c811c2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:23.129581 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffda4a0-891a-4639-a736-4aa4c00eb023 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:23.135702 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b058b5b9-d098-4a55-81e9-4cdb92c811c2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:23.137177 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b058b5b9-d098-4a55-81e9-4cdb92c811c2 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:23.150694 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-b058b5b9-d098-4a55-81e9-4cdb92c811c2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 30 00:43:23.150694 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:23.150694 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:23.150694 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:23.150694 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:23.150694 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:23.150694 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:23.150694 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:23.150694 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:23.150694 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:23.150694 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:23.150694 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:23.150694 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:43:23.150694 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:43:23.150694 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:43:23.150694 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:43:23.151701 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:23.151701 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:23.151701 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:43:23.151701 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:23.151701 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:43:23.151701 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:23.151701 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:23.151701 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:23.151701 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:23.151701 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:23.151701 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:23.151701 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:23.151701 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:23.151701 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:23.151701 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:23.151701 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:23.151701 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:23.151701 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:23.152672 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:23.152672 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:23.152672 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:43:23.152672 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:43:23.152672 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:43:23.152672 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:43:23.152672 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:43:23.152672 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:43:23.152672 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 30 00:43:23.152672 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:23.153177 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 225/456] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:43:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:23.154115 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058b5b9-d098-4a55-81e9-4cdb92c811c2 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:23.166428 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81b90d-3fc4-4b6a-a8a3-805f2d4a4fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:23.167054 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81b90d-3fc4-4b6a-a8a3-805f2d4a4fed None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:23.167310 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81b90d-3fc4-4b6a-a8a3-805f2d4a4fed None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:23.167578 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81b90d-3fc4-4b6a-a8a3-805f2d4a4fed None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:23.168897 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81b90d-3fc4-4b6a-a8a3-805f2d4a4fed None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:23.169222 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81b90d-3fc4-4b6a-a8a3-805f2d4a4fed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:23.170611 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81b90d-3fc4-4b6a-a8a3-805f2d4a4fed None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:23.183924 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 232/457] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Oct 30 00:43:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:23.184822 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81b90d-3fc4-4b6a-a8a3-805f2d4a4fed None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:23.190341 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:23.250991 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:23.273291 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058b5b9-d098-4a55-81e9-4cdb92c811c2 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:23.297834 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81b90d-3fc4-4b6a-a8a3-805f2d4a4fed None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:23.311070 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e1266-2506-4f62-aad8-de42fd72a961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:23.312272 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e1266-2506-4f62-aad8-de42fd72a961 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:23.312727 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e1266-2506-4f62-aad8-de42fd72a961 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:23.313220 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e1266-2506-4f62-aad8-de42fd72a961 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:23.328705 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e1266-2506-4f62-aad8-de42fd72a961 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:23.331099 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e1266-2506-4f62-aad8-de42fd72a961 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:23.336591 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefcbf2-34ac-448a-aeee-66ef417d5808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:23.337334 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefcbf2-34ac-448a-aeee-66ef417d5808 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:23.337682 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefcbf2-34ac-448a-aeee-66ef417d5808 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:23.338414 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefcbf2-34ac-448a-aeee-66ef417d5808 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:23.345789 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-380e1266-2506-4f62-aad8-de42fd72a961 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:23.345789 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:23.345789 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:23.345789 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:23.345789 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:23.345789 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:23.345789 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:23.345789 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:23.345789 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:23.345789 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:23.345789 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:23.345789 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:23.345789 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:23.345789 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:23.345789 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:23.345789 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:23.346677 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:23.346677 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:23.346677 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:23.346677 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:23.346677 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:23.346677 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:23.346677 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:23.346677 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:23.346677 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:23.346677 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:23.346677 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:23.346677 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:23.346677 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:23.346677 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:23.346677 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:23.346677 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:23.346677 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:23.347535 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:23.347535 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:23.347535 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:23.347697 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adefcbf2-34ac-448a-aeee-66ef417d5808 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:23.347697 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adefcbf2-34ac-448a-aeee-66ef417d5808 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:23.351654 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 226/458] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:23.352497 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e1266-2506-4f62-aad8-de42fd72a961 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:23.359269 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-adefcbf2-34ac-448a-aeee-66ef417d5808 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:23.359269 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:23.359269 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:23.359269 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:23.359269 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:23.359269 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:23.359269 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:23.359269 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:23.359269 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:23.359269 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:23.359269 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:23.359269 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:23.359269 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:43:23.359269 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:43:23.359269 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:43:23.360096 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:43:23.360096 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:23.360096 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:23.360096 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:23.360096 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:23.360096 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:23.360096 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:23.360096 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:23.360096 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:23.360096 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:23.360096 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:23.360096 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:23.360096 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:23.360096 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:23.360096 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:23.360096 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:23.360096 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:23.360940 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:43:23.360940 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:43:23.360940 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:43:23.360940 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:43:23.360940 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:43:23.360940 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:43:23.360940 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:23.360940 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:23.365079 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 233/459] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:43:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:23.365804 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefcbf2-34ac-448a-aeee-66ef417d5808 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:23.442541 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:23.463860 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e1266-2506-4f62-aad8-de42fd72a961 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:23.469796 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefcbf2-34ac-448a-aeee-66ef417d5808 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:23.486417 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:23.503479 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05951971-6caa-45ab-adc9-ea21e82792d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:23.504051 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05951971-6caa-45ab-adc9-ea21e82792d9 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:23.504334 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05951971-6caa-45ab-adc9-ea21e82792d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:23.504444 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee79c7d-61ab-4f78-9333-afeec172e3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:23.504614 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05951971-6caa-45ab-adc9-ea21e82792d9 None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:23.505010 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee79c7d-61ab-4f78-9333-afeec172e3a5 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:23.505327 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee79c7d-61ab-4f78-9333-afeec172e3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:23.505435 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05951971-6caa-45ab-adc9-ea21e82792d9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:23.505600 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee79c7d-61ab-4f78-9333-afeec172e3a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:23.505692 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05951971-6caa-45ab-adc9-ea21e82792d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:23.508903 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05951971-6caa-45ab-adc9-ea21e82792d9 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:23.519532 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee79c7d-61ab-4f78-9333-afeec172e3a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:23.521001 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee79c7d-61ab-4f78-9333-afeec172e3a5 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:23.530359 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 227/460] 10.222.0.40 () {56 vars in 1137 bytes} [Sun Oct 30 00:43:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:23.530359 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05951971-6caa-45ab-adc9-ea21e82792d9 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:23.540609 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-8ee79c7d-61ab-4f78-9333-afeec172e3a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:23.540609 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:23.540609 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:23.540609 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:23.540609 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:23.540609 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:23.540609 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:23.540609 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:23.540609 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:23.540609 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:23.540609 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:23.540609 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:23.540609 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:23.540609 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:23.540609 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:23.540609 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:23.541599 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:23.541599 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:23.541599 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:23.541599 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:23.541599 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:23.541599 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:23.541599 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:23.541599 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:23.541599 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:23.541599 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:23.541599 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:23.541599 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:23.541599 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:23.541599 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:23.541599 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:23.541599 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:23.541599 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:23.542473 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:23.542473 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:23.542473 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:23.543340 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 234/461] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:23.544204 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee79c7d-61ab-4f78-9333-afeec172e3a5 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:23.634984 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05951971-6caa-45ab-adc9-ea21e82792d9 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:23.651016 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee79c7d-61ab-4f78-9333-afeec172e3a5 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:23.674258 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd051fc7-946e-4c39-b988-d52fb4621e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:23.674864 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd051fc7-946e-4c39-b988-d52fb4621e11 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:23.675140 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd051fc7-946e-4c39-b988-d52fb4621e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:23.675409 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd051fc7-946e-4c39-b988-d52fb4621e11 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:23.676039 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd051fc7-946e-4c39-b988-d52fb4621e11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:23.676333 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd051fc7-946e-4c39-b988-d52fb4621e11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:23.677733 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd051fc7-946e-4c39-b988-d52fb4621e11 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:23.687357 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:23.695625 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 228/462] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:23.695625 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd051fc7-946e-4c39-b988-d52fb4621e11 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:23.700280 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26687910-8be8-4310-90ef-14aa881cbee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:23.700886 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26687910-8be8-4310-90ef-14aa881cbee8 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:23.701164 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26687910-8be8-4310-90ef-14aa881cbee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:23.701463 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26687910-8be8-4310-90ef-14aa881cbee8 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:23.702148 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26687910-8be8-4310-90ef-14aa881cbee8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:23.702450 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26687910-8be8-4310-90ef-14aa881cbee8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:23.703891 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26687910-8be8-4310-90ef-14aa881cbee8 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:23.717095 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 235/463] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Oct 30 00:43:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:23.718284 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26687910-8be8-4310-90ef-14aa881cbee8 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:23.747701 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:23.811836 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd051fc7-946e-4c39-b988-d52fb4621e11 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:23.818083 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26687910-8be8-4310-90ef-14aa881cbee8 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:23.847989 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669f2da-fa92-4165-9483-8533b59b6642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:23.848579 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669f2da-fa92-4165-9483-8533b59b6642 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:23.848852 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669f2da-fa92-4165-9483-8533b59b6642 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:23.849120 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669f2da-fa92-4165-9483-8533b59b6642 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:23.854753 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a2d5d-1a52-472b-9f53-cce43819d83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:23.855358 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a2d5d-1a52-472b-9f53-cce43819d83d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:23.855663 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a2d5d-1a52-472b-9f53-cce43819d83d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:23.855934 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a2d5d-1a52-472b-9f53-cce43819d83d None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:23.856565 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a2d5d-1a52-472b-9f53-cce43819d83d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:23.856921 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a2d5d-1a52-472b-9f53-cce43819d83d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:23.858409 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a2d5d-1a52-472b-9f53-cce43819d83d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:23.869740 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 236/464] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:23.874703 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a2d5d-1a52-472b-9f53-cce43819d83d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:23.919107 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:23.922694 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669f2da-fa92-4165-9483-8533b59b6642 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:23.924508 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669f2da-fa92-4165-9483-8533b59b6642 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:23.968780 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:23.979455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a2d5d-1a52-472b-9f53-cce43819d83d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:24.012410 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c4af5-fee1-4a1e-9b4f-318947bcca19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:24.013056 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c4af5-fee1-4a1e-9b4f-318947bcca19 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:24.013363 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c4af5-fee1-4a1e-9b4f-318947bcca19 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:24.013634 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c4af5-fee1-4a1e-9b4f-318947bcca19 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:24.020874 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c4af5-fee1-4a1e-9b4f-318947bcca19 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:24.022417 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c4af5-fee1-4a1e-9b4f-318947bcca19 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:24.037224 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 229/465] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Oct 30 00:43:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:43:24.037224 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669f2da-fa92-4165-9483-8533b59b6642 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:24.037454 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-917c4af5-fee1-4a1e-9b4f-318947bcca19 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 30 00:43:24.037454 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:24.037454 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:24.037454 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:24.037454 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:24.037454 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:24.037454 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:24.037454 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:24.037454 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:24.037454 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:24.037454 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:24.037454 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:24.037454 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:43:24.037454 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:43:24.037454 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:43:24.037454 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:43:24.038305 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:24.038305 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:24.038305 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:43:24.038305 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:24.038305 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:43:24.038305 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:24.038305 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:24.038305 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:24.038305 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:24.038305 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:24.038305 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:24.038305 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:24.038305 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:24.038305 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:24.038305 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:24.038305 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:24.038305 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:24.038305 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:24.039226 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:24.039226 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:24.039226 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:43:24.039226 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:43:24.039226 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:43:24.039226 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:43:24.039226 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:43:24.039226 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:43:24.039226 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 30 00:43:24.039226 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:24.039226 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 237/466] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:43:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:24.039226 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c4af5-fee1-4a1e-9b4f-318947bcca19 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:24.140955 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c4af5-fee1-4a1e-9b4f-318947bcca19 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:24.145505 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:24.148251 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669f2da-fa92-4165-9483-8533b59b6642 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:24.177227 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493a018-05f6-4a66-8181-7cd2ebdcdc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:24.177872 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493a018-05f6-4a66-8181-7cd2ebdcdc1e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:24.178152 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493a018-05f6-4a66-8181-7cd2ebdcdc1e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:24.178429 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493a018-05f6-4a66-8181-7cd2ebdcdc1e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:24.184585 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e916b-f8ed-47fd-874f-460556866416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:24.185247 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e916b-f8ed-47fd-874f-460556866416 None admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:24.185538 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e916b-f8ed-47fd-874f-460556866416 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:24.185808 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e916b-f8ed-47fd-874f-460556866416 None admin] PATH_INFO: `/v3/projects/8969ed754fe24784a2025cbdbf6f1a8b/users/b996b01e045b4034be43a907536079c0/roles/53b761158f744776b470f11e00bdaa81` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:24.186649 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493a018-05f6-4a66-8181-7cd2ebdcdc1e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:24.188101 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493a018-05f6-4a66-8181-7cd2ebdcdc1e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:24.199228 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-5493a018-05f6-4a66-8181-7cd2ebdcdc1e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 30 00:43:24.199228 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:24.199228 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:24.199228 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:24.199228 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:24.199228 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:24.199228 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:24.199228 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:24.199228 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:24.199228 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:24.199228 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:24.199228 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:24.199228 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:43:24.199228 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:43:24.199228 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:43:24.199228 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:43:24.200337 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:24.200337 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:24.200337 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:43:24.200337 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:24.200337 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:43:24.200337 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:24.200337 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:24.200337 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:24.200337 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:24.200337 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:24.200337 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:24.200337 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:24.200337 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:24.200337 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:24.200337 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:24.200337 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:24.200337 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:24.200337 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:24.201801 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:24.201801 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:24.201801 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:43:24.201801 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:43:24.201801 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:43:24.201801 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:43:24.201801 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:43:24.201801 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:43:24.201801 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 30 00:43:24.201801 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:24.201801 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 238/467] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Oct 30 00:43:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:24.201801 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493a018-05f6-4a66-8181-7cd2ebdcdc1e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:24.202456 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e916b-f8ed-47fd-874f-460556866416 None admin] RBAC: Authorizing `identity:create_grant(project_id=8969ed754fe24784a2025cbdbf6f1a8b, user_id=b996b01e045b4034be43a907536079c0, role_id=53b761158f744776b470f11e00bdaa81)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:24.203843 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e916b-f8ed-47fd-874f-460556866416 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:24.218145 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 230/468] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Oct 30 00:43:24 2022] PUT /identity/v3/projects/8969ed754fe24784a2025cbdbf6f1a8b/users/b996b01e045b4034be43a907536079c0/roles/53b761158f744776b470f11e00bdaa81 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:43:24.219867 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e916b-f8ed-47fd-874f-460556866416 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:24.225896 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:24.321347 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493a018-05f6-4a66-8181-7cd2ebdcdc1e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:24.343219 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e916b-f8ed-47fd-874f-460556866416 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:24.360520 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb86849-0d8b-46db-b7f6-8ce282e2256c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:24.361560 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb86849-0d8b-46db-b7f6-8ce282e2256c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:24.362048 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb86849-0d8b-46db-b7f6-8ce282e2256c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:24.362529 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb86849-0d8b-46db-b7f6-8ce282e2256c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:24.376469 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb86849-0d8b-46db-b7f6-8ce282e2256c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:24.378328 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb86849-0d8b-46db-b7f6-8ce282e2256c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:24.382779 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee513d6-f7f2-4efb-b867-6568cf7aacd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:24.383398 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee513d6-f7f2-4efb-b867-6568cf7aacd8 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:24.383671 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee513d6-f7f2-4efb-b867-6568cf7aacd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:24.383939 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee513d6-f7f2-4efb-b867-6568cf7aacd8 None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:24.384675 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee513d6-f7f2-4efb-b867-6568cf7aacd8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:24.384985 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee513d6-f7f2-4efb-b867-6568cf7aacd8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:24.386536 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee513d6-f7f2-4efb-b867-6568cf7aacd8 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:24.396635 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-4fb86849-0d8b-46db-b7f6-8ce282e2256c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:24.396635 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:24.396635 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:24.396635 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:24.396635 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:24.396635 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:24.396635 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:24.396635 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:24.396635 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:24.396635 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:24.396635 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:24.396635 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:24.396635 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:24.396635 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:24.396635 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:24.396635 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:24.397606 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:24.397606 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:24.397606 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:24.397606 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:24.397606 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:24.397606 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:24.397606 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:24.397606 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:24.397606 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:24.397606 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:24.397606 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:24.397606 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:24.397606 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:24.397606 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:24.397606 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:24.397606 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:24.397606 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:24.398466 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:24.398466 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:24.398466 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:24.405476 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 239/469] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:24.406569 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 231/470] 10.222.0.40 () {56 vars in 1137 bytes} [Sun Oct 30 00:43:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:24.406971 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb86849-0d8b-46db-b7f6-8ce282e2256c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:24.413564 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee513d6-f7f2-4efb-b867-6568cf7aacd8 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:24.425495 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:24.497866 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:24.525907 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee513d6-f7f2-4efb-b867-6568cf7aacd8 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:24.542543 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb86849-0d8b-46db-b7f6-8ce282e2256c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:24.568788 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa82bb3-6744-4532-adf4-55eede810f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:24.569744 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa82bb3-6744-4532-adf4-55eede810f01 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:24.570253 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa82bb3-6744-4532-adf4-55eede810f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:24.570721 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa82bb3-6744-4532-adf4-55eede810f01 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:24.571554 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa82bb3-6744-4532-adf4-55eede810f01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:24.572049 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa82bb3-6744-4532-adf4-55eede810f01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:24.573974 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa82bb3-6744-4532-adf4-55eede810f01 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:24.580706 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c946acc-c84d-4ab9-9574-658b64e6ca1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:24.581330 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c946acc-c84d-4ab9-9574-658b64e6ca1c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:24.581613 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c946acc-c84d-4ab9-9574-658b64e6ca1c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:24.581886 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c946acc-c84d-4ab9-9574-658b64e6ca1c None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:24.582614 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c946acc-c84d-4ab9-9574-658b64e6ca1c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:24.582916 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c946acc-c84d-4ab9-9574-658b64e6ca1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:24.584527 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c946acc-c84d-4ab9-9574-658b64e6ca1c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:24.594765 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 232/471] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:24.595917 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa82bb3-6744-4532-adf4-55eede810f01 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:24.603226 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 240/472] 10.222.0.40 () {56 vars in 1139 bytes} [Sun Oct 30 00:43:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:24.603877 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c946acc-c84d-4ab9-9574-658b64e6ca1c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:24.669677 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:24.708501 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa82bb3-6744-4532-adf4-55eede810f01 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:24.723324 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c946acc-c84d-4ab9-9574-658b64e6ca1c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:24.744552 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:24.745887 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c9129-d518-4469-aa93-57a51d2ccffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:24.747322 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c9129-d518-4469-aa93-57a51d2ccffd None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:24.747820 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c9129-d518-4469-aa93-57a51d2ccffd None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:24.748370 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c9129-d518-4469-aa93-57a51d2ccffd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:24.760532 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d174f9-8e5b-4538-89a0-260dd6ee0e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:24.761161 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d174f9-8e5b-4538-89a0-260dd6ee0e47 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:24.761467 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d174f9-8e5b-4538-89a0-260dd6ee0e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:24.761799 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d174f9-8e5b-4538-89a0-260dd6ee0e47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:24.769546 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d174f9-8e5b-4538-89a0-260dd6ee0e47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:24.771165 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d174f9-8e5b-4538-89a0-260dd6ee0e47 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:24.782805 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-c5d174f9-8e5b-4538-89a0-260dd6ee0e47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:24.782805 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:24.782805 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:24.782805 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:24.782805 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:24.782805 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:24.782805 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:24.782805 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:24.782805 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:24.782805 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:24.782805 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:24.782805 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:24.782805 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:43:24.782805 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:43:24.782805 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:43:24.783660 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:43:24.783660 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:24.783660 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:24.783660 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:24.783660 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:24.783660 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:24.783660 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:24.783660 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:24.783660 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:24.783660 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:24.783660 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:24.783660 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:24.783660 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:24.783660 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:24.783660 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:24.783660 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:24.783660 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:24.784530 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:43:24.784530 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:43:24.784530 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:43:24.784530 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:43:24.784530 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:43:24.784530 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:43:24.784530 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:24.784530 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:24.788634 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 241/473] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:43:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:24.789520 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d174f9-8e5b-4538-89a0-260dd6ee0e47 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:24.828762 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c9129-d518-4469-aa93-57a51d2ccffd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:24.830605 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c9129-d518-4469-aa93-57a51d2ccffd None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:24.893904 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d174f9-8e5b-4538-89a0-260dd6ee0e47 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:24.901307 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:24.931291 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95727229-931e-465d-aa67-970cadb5cc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:24.931809 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95727229-931e-465d-aa67-970cadb5cc0e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:24.932146 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95727229-931e-465d-aa67-970cadb5cc0e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:24.932425 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95727229-931e-465d-aa67-970cadb5cc0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:24.949022 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 233/474] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Oct 30 00:43:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:43:24.950914 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c9129-d518-4469-aa93-57a51d2ccffd None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:24.984408 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:25.006448 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95727229-931e-465d-aa67-970cadb5cc0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:25.007902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95727229-931e-465d-aa67-970cadb5cc0e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:25.056414 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c9129-d518-4469-aa93-57a51d2ccffd None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:25.093131 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f9039-26b4-4c7b-8417-c915fdd913a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:25.093896 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f9039-26b4-4c7b-8417-c915fdd913a0 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:25.094276 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f9039-26b4-4c7b-8417-c915fdd913a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:25.094651 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f9039-26b4-4c7b-8417-c915fdd913a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:25.095451 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f9039-26b4-4c7b-8417-c915fdd913a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:25.095854 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f9039-26b4-4c7b-8417-c915fdd913a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:25.097422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f9039-26b4-4c7b-8417-c915fdd913a0 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:25.109886 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 234/475] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Oct 30 00:43:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:25.111058 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f9039-26b4-4c7b-8417-c915fdd913a0 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:25.137311 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 242/476] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Oct 30 00:43:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:43:25.138210 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95727229-931e-465d-aa67-970cadb5cc0e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:25.148316 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:25.228361 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f9039-26b4-4c7b-8417-c915fdd913a0 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:25.254837 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95727229-931e-465d-aa67-970cadb5cc0e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:25.256882 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:25.264830 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a410e0a-2973-4c02-815d-83a5d25ab8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:25.265638 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a410e0a-2973-4c02-815d-83a5d25ab8e8 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:25.266014 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a410e0a-2973-4c02-815d-83a5d25ab8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:25.266388 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a410e0a-2973-4c02-815d-83a5d25ab8e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:25.278345 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a410e0a-2973-4c02-815d-83a5d25ab8e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:25.279888 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a410e0a-2973-4c02-815d-83a5d25ab8e8 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:25.293039 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b675fc6-76bb-419a-96d2-9925f5c335a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:25.293656 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b675fc6-76bb-419a-96d2-9925f5c335a9 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:25.293934 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b675fc6-76bb-419a-96d2-9925f5c335a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:25.294199 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b675fc6-76bb-419a-96d2-9925f5c335a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:25.294433 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-9a410e0a-2973-4c02-815d-83a5d25ab8e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:25.294433 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:25.294433 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:25.294433 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:25.294433 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:25.294433 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:25.294433 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:25.294433 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:25.294433 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:25.294433 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:25.294433 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:25.294433 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:25.294433 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:25.294433 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:25.294433 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:25.294433 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:25.295410 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:25.295410 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:25.295410 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:25.295410 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:25.295410 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:25.295410 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:25.295410 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:25.295410 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:25.295410 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:25.295410 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:25.295410 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:25.295410 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:25.295410 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:25.295410 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:25.295410 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:25.295410 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:25.295410 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:25.296442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:25.296442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:25.296442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:25.296636 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b675fc6-76bb-419a-96d2-9925f5c335a9 None admin] RBAC: Adding query filter params (role.id=53b761158f744776b470f11e00bdaa81, scope.project.id=8969ed754fe24784a2025cbdbf6f1a8b, user.id=507ae56497684fc08f05c65a3c23e898) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:25.296636 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b675fc6-76bb-419a-96d2-9925f5c335a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:25.296636 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b675fc6-76bb-419a-96d2-9925f5c335a9 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:25.297937 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 235/477] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:25.302497 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 243/478] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Oct 30 00:43:25 2022] GET /identity/v3/role_assignments?user.id=507ae56497684fc08f05c65a3c23e898&scope.project.id=8969ed754fe24784a2025cbdbf6f1a8b&role.id=53b761158f744776b470f11e00bdaa81 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:25.303227 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a410e0a-2973-4c02-815d-83a5d25ab8e8 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:25.314439 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19565894-7e44-4203-a6e4-511c347e9a11 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:25.314885 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19565894-7e44-4203-a6e4-511c347e9a11 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:25.315260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19565894-7e44-4203-a6e4-511c347e9a11 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:25.321231 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 244/479] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:25.321231 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19565894-7e44-4203-a6e4-511c347e9a11 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:25.423990 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:25.446888 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a410e0a-2973-4c02-815d-83a5d25ab8e8 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:25.449720 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19565894-7e44-4203-a6e4-511c347e9a11 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:25.493849 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c76c7-94b7-4f5e-a0ae-3c37a13978c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:25.494393 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c76c7-94b7-4f5e-a0ae-3c37a13978c9 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:25.494666 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c76c7-94b7-4f5e-a0ae-3c37a13978c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:25.494808 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99a5c1-1428-47ce-99e9-5f009d46c4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:25.494936 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c76c7-94b7-4f5e-a0ae-3c37a13978c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:25.495604 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99a5c1-1428-47ce-99e9-5f009d46c4c5 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:25.495889 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99a5c1-1428-47ce-99e9-5f009d46c4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:25.496746 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99a5c1-1428-47ce-99e9-5f009d46c4c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:25.497596 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99a5c1-1428-47ce-99e9-5f009d46c4c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:25.497912 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99a5c1-1428-47ce-99e9-5f009d46c4c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:25.499614 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99a5c1-1428-47ce-99e9-5f009d46c4c5 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:25.506466 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c76c7-94b7-4f5e-a0ae-3c37a13978c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:25.507908 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c76c7-94b7-4f5e-a0ae-3c37a13978c9 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:25.513841 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 245/480] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:25.515260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a8fb7-8f41-4dd7-bfff-a2be14754212 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:25.515550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a8fb7-8f41-4dd7-bfff-a2be14754212 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:25.515822 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a8fb7-8f41-4dd7-bfff-a2be14754212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:25.524521 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-fb1c76c7-94b7-4f5e-a0ae-3c37a13978c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:25.524521 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:25.524521 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:25.524521 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:25.524521 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:25.524521 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:25.524521 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:25.524521 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:25.524521 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:25.524521 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:25.524521 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:25.524521 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:25.524521 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:25.524521 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:25.524521 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:25.524521 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:25.525796 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:25.525796 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:25.525796 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:25.525796 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:25.525796 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:25.525796 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:25.525796 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:25.525796 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:25.525796 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:25.525796 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:25.525796 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:25.525796 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:25.525796 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:25.525796 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:25.525796 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:25.525796 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:25.525796 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:25.526932 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:25.526932 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:25.526932 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:25.527138 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:25.527763 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 236/481] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:25.527763 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c76c7-94b7-4f5e-a0ae-3c37a13978c9 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:25.540004 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-e34a8fb7-8f41-4dd7-bfff-a2be14754212 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:25.541511 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e34a8fb7-8f41-4dd7-bfff-a2be14754212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:25.628998 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 246/482] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:43:25.630313 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a8fb7-8f41-4dd7-bfff-a2be14754212 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:25.648793 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c76c7-94b7-4f5e-a0ae-3c37a13978c9 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:25.690604 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:25.696012 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b3a45-b0c2-4628-89dc-3e7eb1a010e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:25.696990 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b3a45-b0c2-4628-89dc-3e7eb1a010e2 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:25.701568 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b3a45-b0c2-4628-89dc-3e7eb1a010e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:25.701965 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b3a45-b0c2-4628-89dc-3e7eb1a010e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:25.711905 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b3a45-b0c2-4628-89dc-3e7eb1a010e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:25.713528 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b3a45-b0c2-4628-89dc-3e7eb1a010e2 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:25.741358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-922b3a45-b0c2-4628-89dc-3e7eb1a010e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:25.741358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:25.741358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:25.741358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:25.741358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:25.741358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:25.741358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:25.741358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:25.741358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:25.741358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:25.741358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:25.741358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:25.741358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:43:25.741358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:43:25.741358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:43:25.742278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:43:25.742278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:25.742278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:25.742278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:25.742278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:25.742278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:25.742278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:25.742278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:25.742278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:25.742278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:25.742278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:25.742278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:25.742278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:25.742278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:25.742278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:25.742278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:25.742278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:25.743263 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:43:25.743263 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:43:25.743263 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:43:25.743263 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:43:25.743263 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:43:25.743263 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:43:25.743263 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:25.743263 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:25.743263 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 237/483] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:43:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:25.754110 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b3a45-b0c2-4628-89dc-3e7eb1a010e2 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:25.756258 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a8fb7-8f41-4dd7-bfff-a2be14754212 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:25.796095 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f47f18-97ab-4588-90fd-c690e046adb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:25.797680 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f47f18-97ab-4588-90fd-c690e046adb4 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:25.798461 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f47f18-97ab-4588-90fd-c690e046adb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:25.799230 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f47f18-97ab-4588-90fd-c690e046adb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:25.800172 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f47f18-97ab-4588-90fd-c690e046adb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:25.800956 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f47f18-97ab-4588-90fd-c690e046adb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:25.802937 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f47f18-97ab-4588-90fd-c690e046adb4 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:25.804640 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:25.817934 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 247/484] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:25.823157 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f47f18-97ab-4588-90fd-c690e046adb4 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:25.942776 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b3a45-b0c2-4628-89dc-3e7eb1a010e2 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:25.976491 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f47f18-97ab-4588-90fd-c690e046adb4 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:25.982028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe62b29-c074-46da-a068-2a88aaec7044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:25.982625 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe62b29-c074-46da-a068-2a88aaec7044 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:25.982895 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe62b29-c074-46da-a068-2a88aaec7044 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:25.983159 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe62b29-c074-46da-a068-2a88aaec7044 None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:25.983839 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe62b29-c074-46da-a068-2a88aaec7044 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:25.984139 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe62b29-c074-46da-a068-2a88aaec7044 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:25.986404 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe62b29-c074-46da-a068-2a88aaec7044 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:26.001408 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 238/485] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Oct 30 00:43:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:26.006113 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe62b29-c074-46da-a068-2a88aaec7044 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:26.023014 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a8a77-e391-4c49-bdb5-ab27945a5e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:26.024184 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a8a77-e391-4c49-bdb5-ab27945a5e58 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:26.024463 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a8a77-e391-4c49-bdb5-ab27945a5e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:26.024733 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a8a77-e391-4c49-bdb5-ab27945a5e58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:26.033798 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a8a77-e391-4c49-bdb5-ab27945a5e58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:26.035898 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a8a77-e391-4c49-bdb5-ab27945a5e58 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:26.052165 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-2b2a8a77-e391-4c49-bdb5-ab27945a5e58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:26.052165 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:26.052165 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:26.052165 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:26.052165 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:26.052165 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:26.052165 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:26.052165 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:26.052165 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:26.052165 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:26.052165 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:26.052165 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:26.052165 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:43:26.052165 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:43:26.052165 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:43:26.053261 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:43:26.053261 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:26.053261 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:26.053261 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:26.053261 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:26.053261 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:26.053261 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:26.053261 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:26.053261 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:26.053261 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:26.053261 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:26.053261 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:26.053261 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:26.053261 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:26.053261 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:26.053261 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:26.053261 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:26.054372 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:43:26.054372 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:43:26.054372 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:43:26.054372 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:43:26.054372 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:43:26.054372 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:43:26.054372 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:26.054372 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:26.057270 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 248/486] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:43:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:26.058183 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a8a77-e391-4c49-bdb5-ab27945a5e58 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:26.070047 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:26.126854 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe62b29-c074-46da-a068-2a88aaec7044 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:26.138362 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:26.175364 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38adfb9-44d2-4429-92ac-d89954260750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:26.176684 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38adfb9-44d2-4429-92ac-d89954260750 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:26.177165 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38adfb9-44d2-4429-92ac-d89954260750 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:26.178228 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38adfb9-44d2-4429-92ac-d89954260750 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:26.190101 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a8a77-e391-4c49-bdb5-ab27945a5e58 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:26.191396 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38adfb9-44d2-4429-92ac-d89954260750 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:43:26.198164 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-c38adfb9-44d2-4429-92ac-d89954260750 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:43:26.198164 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:26.198164 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:26.198164 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:26.198164 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:26.198164 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:26.198164 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:26.198164 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:26.198164 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:26.198164 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:26.198164 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:26.198164 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:26.198164 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:43:26.198164 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:43:26.198164 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:43:26.198164 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:43:26.199035 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:43:26.199035 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:43:26.199035 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:43:26.199035 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:43:26.199035 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:26.199035 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:26.199035 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:26.199035 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:26.199035 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:26.199035 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:26.199035 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:26.199035 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:26.199035 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:26.199035 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:26.199035 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:26.199035 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:26.200411 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:26.200411 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:26.200411 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:26.200411 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:26.200411 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:43:26.200411 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:43:26.200411 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:43:26.200411 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:43:26.200411 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:43:26.200411 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:43:26.200411 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:43:26.200411 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:26.203024 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 239/487] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Oct 30 00:43:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:26.203945 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38adfb9-44d2-4429-92ac-d89954260750 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:26.234134 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08b0c1-bdbc-44a6-b9e3-7ec5030cb6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:26.234939 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08b0c1-bdbc-44a6-b9e3-7ec5030cb6fa None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:26.235352 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08b0c1-bdbc-44a6-b9e3-7ec5030cb6fa None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:26.235776 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08b0c1-bdbc-44a6-b9e3-7ec5030cb6fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:26.236589 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08b0c1-bdbc-44a6-b9e3-7ec5030cb6fa None admin] RBAC: Adding query filter params (role.id=53b761158f744776b470f11e00bdaa81, scope.project.id=8969ed754fe24784a2025cbdbf6f1a8b, user.id=0dfd57a56ebe41ebb2b836d1ab03e334) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:26.237029 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08b0c1-bdbc-44a6-b9e3-7ec5030cb6fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:26.238891 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08b0c1-bdbc-44a6-b9e3-7ec5030cb6fa None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:26.253666 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 249/488] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Oct 30 00:43:26 2022] GET /identity/v3/role_assignments?user.id=0dfd57a56ebe41ebb2b836d1ab03e334&scope.project.id=8969ed754fe24784a2025cbdbf6f1a8b&role.id=53b761158f744776b470f11e00bdaa81 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:26.254773 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08b0c1-bdbc-44a6-b9e3-7ec5030cb6fa None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:26.329649 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38adfb9-44d2-4429-92ac-d89954260750 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:26.346772 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:26.373123 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f6a7e-d1e3-4b5f-ab26-bb67778a511a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:26.374026 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f6a7e-d1e3-4b5f-ab26-bb67778a511a None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:26.374451 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f6a7e-d1e3-4b5f-ab26-bb67778a511a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:26.375053 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f6a7e-d1e3-4b5f-ab26-bb67778a511a None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:26.375999 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f6a7e-d1e3-4b5f-ab26-bb67778a511a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:26.376448 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f6a7e-d1e3-4b5f-ab26-bb67778a511a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:26.378311 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f6a7e-d1e3-4b5f-ab26-bb67778a511a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:26.392916 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 240/489] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Oct 30 00:43:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:26.399888 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f6a7e-d1e3-4b5f-ab26-bb67778a511a None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:26.515111 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08b0c1-bdbc-44a6-b9e3-7ec5030cb6fa None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:26.525788 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f6a7e-d1e3-4b5f-ab26-bb67778a511a None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:26.539522 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:26.560481 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e2c5f-013e-47ef-ac1d-d4d014cafbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:26.561320 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e2c5f-013e-47ef-ac1d-d4d014cafbea None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:26.562805 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e2c5f-013e-47ef-ac1d-d4d014cafbea None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:26.563177 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e2c5f-013e-47ef-ac1d-d4d014cafbea None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:26.563935 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e2c5f-013e-47ef-ac1d-d4d014cafbea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:26.564335 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e2c5f-013e-47ef-ac1d-d4d014cafbea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:26.565935 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e2c5f-013e-47ef-ac1d-d4d014cafbea None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:26.577401 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 250/490] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:43:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:26.579736 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fe33a-faa4-44b3-9a3a-c2edfa66dbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:26.580481 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fe33a-faa4-44b3-9a3a-c2edfa66dbd5 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:26.580920 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fe33a-faa4-44b3-9a3a-c2edfa66dbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:26.581364 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fe33a-faa4-44b3-9a3a-c2edfa66dbd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:26.582577 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fe33a-faa4-44b3-9a3a-c2edfa66dbd5 None admin] RBAC: Adding query filter params (role.id=53b761158f744776b470f11e00bdaa81, scope.project.id=8969ed754fe24784a2025cbdbf6f1a8b, user.id=93b5c95d6fd64262849f4c09fe0a716f) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:26.583026 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fe33a-faa4-44b3-9a3a-c2edfa66dbd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:26.583137 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e2c5f-013e-47ef-ac1d-d4d014cafbea None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:26.584912 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fe33a-faa4-44b3-9a3a-c2edfa66dbd5 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:26.593767 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 241/491] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Oct 30 00:43:26 2022] GET /identity/v3/role_assignments?user.id=93b5c95d6fd64262849f4c09fe0a716f&scope.project.id=8969ed754fe24784a2025cbdbf6f1a8b&role.id=53b761158f744776b470f11e00bdaa81 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:26.651632 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9546a5-641b-4cba-9348-769a96424204 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:26.653447 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9546a5-641b-4cba-9348-769a96424204 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:26.653842 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9546a5-641b-4cba-9348-769a96424204 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:26.655614 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 242/492] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:43:26.664447 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b68f67-6416-4712-85fd-e8f8687c06c3 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:26.664447 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b68f67-6416-4712-85fd-e8f8687c06c3 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:26.664447 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b68f67-6416-4712-85fd-e8f8687c06c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:26.688865 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-60b68f67-6416-4712-85fd-e8f8687c06c3 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:26.690487 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-60b68f67-6416-4712-85fd-e8f8687c06c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:26.713947 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e2c5f-013e-47ef-ac1d-d4d014cafbea None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:26.734475 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:26.754096 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec5f99-0a05-4dc4-bee8-cb5b6b906661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:26.754739 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec5f99-0a05-4dc4-bee8-cb5b6b906661 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:26.755020 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec5f99-0a05-4dc4-bee8-cb5b6b906661 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:26.755293 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec5f99-0a05-4dc4-bee8-cb5b6b906661 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:26.768265 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec5f99-0a05-4dc4-bee8-cb5b6b906661 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:26.769805 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec5f99-0a05-4dc4-bee8-cb5b6b906661 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:26.785875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-b1ec5f99-0a05-4dc4-bee8-cb5b6b906661 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:26.785875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:26.785875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:26.785875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:26.785875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:26.785875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:26.785875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:26.785875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:26.785875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:26.785875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:26.785875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:26.785875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:26.785875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:26.785875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:26.785875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:26.785875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:26.786854 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:26.786854 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:26.786854 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:26.786854 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:26.786854 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:26.786854 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:26.786854 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:26.786854 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:26.786854 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:26.786854 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:26.786854 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:26.786854 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:26.786854 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:26.786854 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:26.786854 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:26.786854 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:26.786854 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:26.788296 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:26.788296 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:26.788296 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:26.788296 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 251/493] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:43:26.795046 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 243/494] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:43:26.798481 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec5f99-0a05-4dc4-bee8-cb5b6b906661 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:26.833018 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:26.909575 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec5f99-0a05-4dc4-bee8-cb5b6b906661 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:26.947860 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ecc56-900e-407f-b4d5-55b48f1fb8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:26.948813 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ecc56-900e-407f-b4d5-55b48f1fb8a6 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:26.949930 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ecc56-900e-407f-b4d5-55b48f1fb8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:26.950427 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ecc56-900e-407f-b4d5-55b48f1fb8a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:26.951278 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ecc56-900e-407f-b4d5-55b48f1fb8a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:26.951777 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ecc56-900e-407f-b4d5-55b48f1fb8a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:26.953362 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ecc56-900e-407f-b4d5-55b48f1fb8a6 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:26.967742 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 252/495] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:26.973493 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b68f67-6416-4712-85fd-e8f8687c06c3 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:27.075674 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b68f67-6416-4712-85fd-e8f8687c06c3 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:27.105302 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ecc56-900e-407f-b4d5-55b48f1fb8a6 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:27.123906 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7828fa84-f9db-4a8c-82e7-6409527a74ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:27.124887 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828fa84-f9db-4a8c-82e7-6409527a74ad None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:27.125393 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828fa84-f9db-4a8c-82e7-6409527a74ad None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:27.125885 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828fa84-f9db-4a8c-82e7-6409527a74ad None admin] PATH_INFO: `/v3/users/nova` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:27.141378 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7828fa84-f9db-4a8c-82e7-6409527a74ad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:27.142830 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7828fa84-f9db-4a8c-82e7-6409527a74ad None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:27.155422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-7828fa84-f9db-4a8c-82e7-6409527a74ad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:43:27.155422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:27.155422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:27.155422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:27.155422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:27.155422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:27.155422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:27.155422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:27.155422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:27.155422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:27.155422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:27.155422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:27.155422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:43:27.155422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:43:27.155422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:43:27.155422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:43:27.156370 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:27.156370 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:27.156370 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:43:27.156370 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:27.156370 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:43:27.156370 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:27.156370 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:27.156370 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:27.156370 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:27.156370 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:27.156370 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:27.156370 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:27.156370 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:27.156370 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:27.156370 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:27.156370 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:27.156370 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:27.156370 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:27.157409 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:27.157409 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:27.157409 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:43:27.157409 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:43:27.157409 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:43:27.157409 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:43:27.157409 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:43:27.157409 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:43:27.157409 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:43:27.157409 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:27.161175 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 244/496] 10.222.0.40 () {56 vars in 1093 bytes} [Sun Oct 30 00:43:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:27.163448 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7828fa84-f9db-4a8c-82e7-6409527a74ad None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:27.213736 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:27.273564 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:27.295128 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ecc56-900e-407f-b4d5-55b48f1fb8a6 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:27.296221 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7828fa84-f9db-4a8c-82e7-6409527a74ad None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:27.330722 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee581a5-1c69-427b-97cf-15354d5d66aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:27.331345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee581a5-1c69-427b-97cf-15354d5d66aa None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:27.331621 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee581a5-1c69-427b-97cf-15354d5d66aa None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:27.331890 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee581a5-1c69-427b-97cf-15354d5d66aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:27.342863 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee581a5-1c69-427b-97cf-15354d5d66aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:43:27.347693 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-dee581a5-1c69-427b-97cf-15354d5d66aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:43:27.347693 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:27.347693 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:27.347693 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:27.347693 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:27.347693 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:27.347693 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:27.347693 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:27.347693 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:27.347693 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:27.347693 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:27.347693 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:27.347693 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:43:27.347693 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:43:27.347693 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:43:27.347693 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:43:27.348596 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:43:27.348596 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:43:27.348596 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:43:27.348596 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:43:27.348596 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:27.348596 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:27.348596 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:27.348596 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:27.348596 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:27.348596 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:27.348596 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:27.348596 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:27.348596 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:27.348596 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:27.348596 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:27.348596 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:27.349455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:27.349455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:27.349455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:27.349455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:27.349455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:43:27.349455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:43:27.349455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:43:27.349455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:43:27.349455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:43:27.349455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:43:27.349455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:43:27.349455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:27.349455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 253/497] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Oct 30 00:43:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:43:27.353090 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df03585-733a-463d-a9cd-85c070527068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:27.353719 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df03585-733a-463d-a9cd-85c070527068 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:27.353994 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df03585-733a-463d-a9cd-85c070527068 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:27.354265 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df03585-733a-463d-a9cd-85c070527068 None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:27.355097 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee581a5-1c69-427b-97cf-15354d5d66aa None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:27.356779 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df03585-733a-463d-a9cd-85c070527068 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:27.357023 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df03585-733a-463d-a9cd-85c070527068 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:27.358475 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df03585-733a-463d-a9cd-85c070527068 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:27.399500 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 245/498] 10.222.0.40 () {56 vars in 1133 bytes} [Sun Oct 30 00:43:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:27.406327 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df03585-733a-463d-a9cd-85c070527068 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:27.512635 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee581a5-1c69-427b-97cf-15354d5d66aa None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:27.564689 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:27.583226 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df03585-733a-463d-a9cd-85c070527068 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:27.592566 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fab001-ae0e-4a9b-9d16-bb27ca698df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:27.593307 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fab001-ae0e-4a9b-9d16-bb27ca698df1 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:27.593651 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fab001-ae0e-4a9b-9d16-bb27ca698df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:27.593982 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fab001-ae0e-4a9b-9d16-bb27ca698df1 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:27.594733 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fab001-ae0e-4a9b-9d16-bb27ca698df1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:27.595098 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fab001-ae0e-4a9b-9d16-bb27ca698df1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:27.597023 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fab001-ae0e-4a9b-9d16-bb27ca698df1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:27.616893 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 254/499] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Oct 30 00:43:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:43:27.621281 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fab001-ae0e-4a9b-9d16-bb27ca698df1 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:27.644762 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3f795-c9e3-4401-932f-a08b20ba43ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:27.645879 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3f795-c9e3-4401-932f-a08b20ba43ee None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:27.646272 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3f795-c9e3-4401-932f-a08b20ba43ee None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:27.646607 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3f795-c9e3-4401-932f-a08b20ba43ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:27.658504 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:27.660232 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3f795-c9e3-4401-932f-a08b20ba43ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:27.662175 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3f795-c9e3-4401-932f-a08b20ba43ee None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:27.685809 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-cbc3f795-c9e3-4401-932f-a08b20ba43ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:27.685809 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:27.685809 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:27.685809 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:27.685809 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:27.685809 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:27.685809 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:27.685809 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:27.685809 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:27.685809 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:27.685809 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:27.685809 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:27.685809 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:27.685809 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:27.685809 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:27.685809 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:27.686795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:27.686795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:27.686795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:27.686795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:27.686795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:27.686795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:27.686795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:27.686795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:27.686795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:27.686795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:27.686795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:27.686795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:27.686795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:27.686795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:27.686795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:27.686795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:27.686795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:27.688198 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:27.688198 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:27.688198 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:27.690332 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 246/500] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:27.695303 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3f795-c9e3-4401-932f-a08b20ba43ee None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:27.821142 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fab001-ae0e-4a9b-9d16-bb27ca698df1 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:27.842444 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3f795-c9e3-4401-932f-a08b20ba43ee None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:27.866975 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de057b57-96fc-418c-9573-1bea9dc40962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:27.868171 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de057b57-96fc-418c-9573-1bea9dc40962 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:27.869044 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de057b57-96fc-418c-9573-1bea9dc40962 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:27.869538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de057b57-96fc-418c-9573-1bea9dc40962 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:27.879677 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6855bea-cf87-40d5-b4fa-04feab6c4249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:27.880278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6855bea-cf87-40d5-b4fa-04feab6c4249 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:27.880555 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6855bea-cf87-40d5-b4fa-04feab6c4249 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:27.880826 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6855bea-cf87-40d5-b4fa-04feab6c4249 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:27.881488 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6855bea-cf87-40d5-b4fa-04feab6c4249 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:27.881786 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6855bea-cf87-40d5-b4fa-04feab6c4249 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:27.883177 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6855bea-cf87-40d5-b4fa-04feab6c4249 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:27.884855 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de057b57-96fc-418c-9573-1bea9dc40962 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:27.886125 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:27.888389 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de057b57-96fc-418c-9573-1bea9dc40962 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:27.903398 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 247/501] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:27.904788 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd99dc-e5ac-4e0d-80db-92ff86d9c081 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:27.905068 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd99dc-e5ac-4e0d-80db-92ff86d9c081 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:27.905368 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd99dc-e5ac-4e0d-80db-92ff86d9c081 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:27.907550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-de057b57-96fc-418c-9573-1bea9dc40962 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:27.907550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:27.907550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:27.907550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:27.907550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:27.907550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:27.907550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:27.907550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:27.907550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:27.907550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:27.907550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:27.907550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:27.907550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:27.907550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:27.907550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:27.907550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:27.908562 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:27.908562 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:27.908562 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:27.908562 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:27.908562 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:27.908562 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:27.908562 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:27.908562 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:27.908562 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:27.908562 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:27.908562 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:27.908562 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:27.908562 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:27.908562 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:27.908562 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:27.908562 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:27.908562 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:27.909463 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:27.909463 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:27.909463 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:27.910982 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 248/502] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:27.911669 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 255/503] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:43:27.912772 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd99dc-e5ac-4e0d-80db-92ff86d9c081 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:27.918661 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5440c-176d-4a70-9fdb-f45c4bff606e None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:27.919237 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5440c-176d-4a70-9fdb-f45c4bff606e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:27.919984 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5440c-176d-4a70-9fdb-f45c4bff606e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:27.945223 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-3ed5440c-176d-4a70-9fdb-f45c4bff606e None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:27.945223 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3ed5440c-176d-4a70-9fdb-f45c4bff606e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:28.008721 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:28.018071 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 256/504] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:43:28.019037 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5440c-176d-4a70-9fdb-f45c4bff606e None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:28.044149 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd99dc-e5ac-4e0d-80db-92ff86d9c081 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:28.090530 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fbb71-119a-402f-8afa-663e85e4c838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:28.093439 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fbb71-119a-402f-8afa-663e85e4c838 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:28.095057 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fbb71-119a-402f-8afa-663e85e4c838 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:28.095542 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fbb71-119a-402f-8afa-663e85e4c838 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:28.109861 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1fbb71-119a-402f-8afa-663e85e4c838 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:28.111677 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1fbb71-119a-402f-8afa-663e85e4c838 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:28.138664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-5b1fbb71-119a-402f-8afa-663e85e4c838 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:28.138664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:28.138664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:28.138664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:28.138664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:28.138664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:28.138664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:28.138664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:28.138664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:28.138664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:28.138664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:28.138664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:28.138664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:43:28.138664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:43:28.138664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:43:28.139560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:43:28.139560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:28.139560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:28.139560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:28.139560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:28.139560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:28.139560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:28.139560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:28.139560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:28.139560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:28.139560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:28.139560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:28.139560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:28.139560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:28.139560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:28.139560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:28.139560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:28.140515 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:43:28.140515 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:43:28.140515 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:43:28.140515 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:43:28.140515 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:43:28.140515 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:43:28.140515 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:28.140515 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:28.142304 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 249/505] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:43:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:28.149170 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fbb71-119a-402f-8afa-663e85e4c838 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:28.179681 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5440c-176d-4a70-9fdb-f45c4bff606e None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:28.234030 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:28.238515 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09e583-96eb-4f42-be05-24c9cf6f5a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:28.239361 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09e583-96eb-4f42-be05-24c9cf6f5a5f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:28.239646 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09e583-96eb-4f42-be05-24c9cf6f5a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:28.240048 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09e583-96eb-4f42-be05-24c9cf6f5a5f None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:28.240685 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09e583-96eb-4f42-be05-24c9cf6f5a5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:28.240987 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09e583-96eb-4f42-be05-24c9cf6f5a5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:28.242401 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09e583-96eb-4f42-be05-24c9cf6f5a5f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:28.263086 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 257/506] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:28.269611 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09e583-96eb-4f42-be05-24c9cf6f5a5f None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:28.282415 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fbb71-119a-402f-8afa-663e85e4c838 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:28.339405 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:28.374777 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1114133-cc3f-45e7-880c-4a4fc01c0520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:28.375393 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1114133-cc3f-45e7-880c-4a4fc01c0520 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:28.375666 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1114133-cc3f-45e7-880c-4a4fc01c0520 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:28.375932 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1114133-cc3f-45e7-880c-4a4fc01c0520 None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:28.376617 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1114133-cc3f-45e7-880c-4a4fc01c0520 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:28.376918 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1114133-cc3f-45e7-880c-4a4fc01c0520 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:28.378443 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1114133-cc3f-45e7-880c-4a4fc01c0520 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:28.390669 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09e583-96eb-4f42-be05-24c9cf6f5a5f None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:28.413269 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 250/507] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Oct 30 00:43:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:28.414473 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1114133-cc3f-45e7-880c-4a4fc01c0520 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:28.438432 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c183e8d-867d-4afe-ae88-5a11f6c4e36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:28.439288 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c183e8d-867d-4afe-ae88-5a11f6c4e36b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:28.439709 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c183e8d-867d-4afe-ae88-5a11f6c4e36b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:28.440152 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c183e8d-867d-4afe-ae88-5a11f6c4e36b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:28.448323 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c183e8d-867d-4afe-ae88-5a11f6c4e36b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:28.450578 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c183e8d-867d-4afe-ae88-5a11f6c4e36b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:28.462679 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-1c183e8d-867d-4afe-ae88-5a11f6c4e36b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 30 00:43:28.462679 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:28.462679 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:28.462679 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:28.462679 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:28.462679 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:28.462679 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:28.462679 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:28.462679 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:28.462679 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:28.462679 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:28.462679 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:28.462679 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:43:28.462679 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:43:28.462679 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:43:28.462679 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:43:28.463875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:28.463875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:28.463875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:43:28.463875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:28.463875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:43:28.463875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:28.463875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:28.463875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:28.463875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:28.463875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:28.463875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:28.463875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:28.463875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:28.463875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:28.463875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:28.463875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:28.463875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:28.463875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:28.465716 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:28.465716 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:28.465716 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:43:28.465716 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:43:28.465716 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:43:28.465716 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:43:28.465716 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:43:28.465716 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:43:28.465716 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 30 00:43:28.465716 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:28.467839 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 258/508] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Oct 30 00:43:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:28.468725 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c183e8d-867d-4afe-ae88-5a11f6c4e36b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:28.523772 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1114133-cc3f-45e7-880c-4a4fc01c0520 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:28.541971 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:28.561466 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b8162-75e0-4600-b74a-61c06e9d98bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:28.562091 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b8162-75e0-4600-b74a-61c06e9d98bb None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:28.562363 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b8162-75e0-4600-b74a-61c06e9d98bb None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:28.562632 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b8162-75e0-4600-b74a-61c06e9d98bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:28.573909 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b8162-75e0-4600-b74a-61c06e9d98bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:28.575535 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b8162-75e0-4600-b74a-61c06e9d98bb None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:28.583106 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c183e8d-867d-4afe-ae88-5a11f6c4e36b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:28.591471 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-369b8162-75e0-4600-b74a-61c06e9d98bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:28.591471 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:28.591471 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:28.591471 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:28.591471 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:28.591471 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:28.591471 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:28.591471 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:28.591471 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:28.591471 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:28.591471 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:28.591471 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:28.591471 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:28.591471 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:28.591471 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:28.591471 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:28.592549 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:28.592549 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:28.592549 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:28.592549 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:28.592549 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:28.592549 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:28.592549 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:28.592549 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:28.592549 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:28.592549 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:28.592549 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:28.592549 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:28.592549 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:28.592549 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:28.592549 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:28.592549 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:28.592549 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:28.593625 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:28.593625 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:28.593625 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:28.593625 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 251/509] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:28.593848 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b8162-75e0-4600-b74a-61c06e9d98bb None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:28.613065 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:28.634786 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d948c1-17b9-447b-9630-4417fc60ee03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:28.635799 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d948c1-17b9-447b-9630-4417fc60ee03 None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:28.636078 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d948c1-17b9-447b-9630-4417fc60ee03 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:28.636346 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d948c1-17b9-447b-9630-4417fc60ee03 None admin] PATH_INFO: `/v3/projects/8969ed754fe24784a2025cbdbf6f1a8b/users/4237b425d9fa4a60b10802e5b108d542/roles/17d0330d6df84d3091d7ef234dfc4e6b` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:28.638840 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d948c1-17b9-447b-9630-4417fc60ee03 None admin] RBAC: Authorizing `identity:create_grant(project_id=8969ed754fe24784a2025cbdbf6f1a8b, user_id=4237b425d9fa4a60b10802e5b108d542, role_id=17d0330d6df84d3091d7ef234dfc4e6b)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:28.640329 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d948c1-17b9-447b-9630-4417fc60ee03 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:28.657340 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 259/510] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Oct 30 00:43:28 2022] PUT /identity/v3/projects/8969ed754fe24784a2025cbdbf6f1a8b/users/4237b425d9fa4a60b10802e5b108d542/roles/17d0330d6df84d3091d7ef234dfc4e6b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:43:28.658379 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d948c1-17b9-447b-9630-4417fc60ee03 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:28.761968 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b8162-75e0-4600-b74a-61c06e9d98bb None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:28.833939 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad5d40-a314-4ad8-a65d-608f8b228036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:28.835777 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad5d40-a314-4ad8-a65d-608f8b228036 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:28.836408 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad5d40-a314-4ad8-a65d-608f8b228036 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:28.838292 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad5d40-a314-4ad8-a65d-608f8b228036 None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:28.839402 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad5d40-a314-4ad8-a65d-608f8b228036 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:28.841696 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad5d40-a314-4ad8-a65d-608f8b228036 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:28.843566 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad5d40-a314-4ad8-a65d-608f8b228036 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:28.878483 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d948c1-17b9-447b-9630-4417fc60ee03 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:28.884712 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 252/511] 10.222.0.40 () {56 vars in 1135 bytes} [Sun Oct 30 00:43:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:28.892525 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad5d40-a314-4ad8-a65d-608f8b228036 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:28.920392 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1854da-2225-46c4-8f28-94b3518c18da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:28.920962 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1854da-2225-46c4-8f28-94b3518c18da None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:28.921308 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1854da-2225-46c4-8f28-94b3518c18da None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:28.921582 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1854da-2225-46c4-8f28-94b3518c18da None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:28.922226 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1854da-2225-46c4-8f28-94b3518c18da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:28.922524 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1854da-2225-46c4-8f28-94b3518c18da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:28.924163 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1854da-2225-46c4-8f28-94b3518c18da None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:28.932850 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:28.939098 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 260/512] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:28.945374 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1854da-2225-46c4-8f28-94b3518c18da None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:28.989686 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:29.023717 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad5d40-a314-4ad8-a65d-608f8b228036 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:29.069540 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1854da-2225-46c4-8f28-94b3518c18da None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:29.071974 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ef63f-e3fc-4a0a-b08f-e9cb16b9e6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:29.073565 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ef63f-e3fc-4a0a-b08f-e9cb16b9e6a4 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:29.073845 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ef63f-e3fc-4a0a-b08f-e9cb16b9e6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:29.074654 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ef63f-e3fc-4a0a-b08f-e9cb16b9e6a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:29.107595 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb7cf6-a62e-45e7-9660-30c138f93f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:29.108582 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb7cf6-a62e-45e7-9660-30c138f93f18 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:29.109133 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb7cf6-a62e-45e7-9660-30c138f93f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:29.109682 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb7cf6-a62e-45e7-9660-30c138f93f18 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:29.110531 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb7cf6-a62e-45e7-9660-30c138f93f18 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:29.112213 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb7cf6-a62e-45e7-9660-30c138f93f18 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:29.137269 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 261/513] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Oct 30 00:43:28 2022] POST /identity/v3/users => generated 254 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:43:29.139501 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6355e2a-1240-4416-9da0-6aad2007ef99 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:29.140248 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6355e2a-1240-4416-9da0-6aad2007ef99 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:29.140731 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6355e2a-1240-4416-9da0-6aad2007ef99 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:29.143409 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 262/514] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:29.149409 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c5b5c-9fc6-4ede-a28b-3500cc116fb2 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:29.150240 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c5b5c-9fc6-4ede-a28b-3500cc116fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:29.150726 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c5b5c-9fc6-4ede-a28b-3500cc116fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:29.159620 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ef63f-e3fc-4a0a-b08f-e9cb16b9e6a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:29.161407 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ef63f-e3fc-4a0a-b08f-e9cb16b9e6a4 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:29.186529 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-720c5b5c-9fc6-4ede-a28b-3500cc116fb2 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:29.186529 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-720c5b5c-9fc6-4ede-a28b-3500cc116fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:29.205955 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:29.304470 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 263/515] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:43:29.347766 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 253/516] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Oct 30 00:43:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:43:29.353770 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c5b5c-9fc6-4ede-a28b-3500cc116fb2 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:29.379292 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:29.445701 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803280d-656f-4156-ae1b-6fe6c7b3c416 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:29.445887 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803280d-656f-4156-ae1b-6fe6c7b3c416 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:29.446160 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803280d-656f-4156-ae1b-6fe6c7b3c416 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:29.447475 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 254/517] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:29.452877 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcae01-1e10-4303-90f4-43d9484c0993 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:29.453159 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcae01-1e10-4303-90f4-43d9484c0993 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:29.453487 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcae01-1e10-4303-90f4-43d9484c0993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:29.467437 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c5b5c-9fc6-4ede-a28b-3500cc116fb2 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:29.478028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-dfdcae01-1e10-4303-90f4-43d9484c0993 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:29.479408 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-dfdcae01-1e10-4303-90f4-43d9484c0993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:29.505557 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471f4a0-bf71-4557-839c-f221476554c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:29.505557 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471f4a0-bf71-4557-839c-f221476554c2 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:29.506054 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471f4a0-bf71-4557-839c-f221476554c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:29.506432 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471f4a0-bf71-4557-839c-f221476554c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:29.517765 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471f4a0-bf71-4557-839c-f221476554c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:29.519457 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471f4a0-bf71-4557-839c-f221476554c2 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:29.536257 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-3471f4a0-bf71-4557-839c-f221476554c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:29.536257 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:29.536257 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:29.536257 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:29.536257 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:29.536257 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:29.536257 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:29.536257 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:29.536257 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:29.536257 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:29.536257 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:29.536257 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:29.536257 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:29.536257 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:29.536257 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:29.536257 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:29.537369 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:29.537369 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:29.537369 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:29.537369 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:29.537369 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:29.537369 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:29.537369 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:29.537369 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:29.537369 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:29.537369 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:29.537369 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:29.537369 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:29.537369 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:29.537369 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:29.537369 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:29.537369 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:29.537369 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:29.538447 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:29.538447 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:29.538447 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:29.539947 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 264/518] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:29.548037 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471f4a0-bf71-4557-839c-f221476554c2 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:29.558118 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 255/519] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:43:29.632234 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdcae01-1e10-4303-90f4-43d9484c0993 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:29.669511 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:29.697646 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:29.725559 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471f4a0-bf71-4557-839c-f221476554c2 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:29.781662 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdcae01-1e10-4303-90f4-43d9484c0993 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:29.803305 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306e6e6-8671-473c-8bd1-eb6d1eb594f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:29.804072 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306e6e6-8671-473c-8bd1-eb6d1eb594f5 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:29.804460 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306e6e6-8671-473c-8bd1-eb6d1eb594f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:29.804839 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306e6e6-8671-473c-8bd1-eb6d1eb594f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:29.805621 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306e6e6-8671-473c-8bd1-eb6d1eb594f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:29.806031 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306e6e6-8671-473c-8bd1-eb6d1eb594f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:29.807498 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306e6e6-8671-473c-8bd1-eb6d1eb594f5 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:29.820256 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 265/520] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:29.825995 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306e6e6-8671-473c-8bd1-eb6d1eb594f5 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:29.848693 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32b6ff-97ff-4b1d-a5e3-625d25d688a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:29.849791 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32b6ff-97ff-4b1d-a5e3-625d25d688a4 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:29.851530 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32b6ff-97ff-4b1d-a5e3-625d25d688a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:29.851981 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32b6ff-97ff-4b1d-a5e3-625d25d688a4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:29.852725 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32b6ff-97ff-4b1d-a5e3-625d25d688a4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:29.855568 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32b6ff-97ff-4b1d-a5e3-625d25d688a4 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:29.873062 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-9a32b6ff-97ff-4b1d-a5e3-625d25d688a4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 30 00:43:29.873062 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:29.873062 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:43:29.873062 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:43:29.873062 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:43:29.873062 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:43:29.873062 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:43:29.873062 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:29.873062 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 30 00:43:29.873062 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:29.873062 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:43:29.873062 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:29.873062 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:29.873062 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:29.873062 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:29.873062 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:29.873062 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:29.874121 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:29.874121 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:29.874121 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:29.874121 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:29.874121 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:29.874121 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:29.874121 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:43:29.874121 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:43:29.874121 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:43:29.874121 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:43:29.874121 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:29.874121 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:29.874121 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:29.874121 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:29.874121 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:29.874121 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:29.874963 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:29.874963 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:29.874963 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:29.874963 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:29.874963 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:29.874963 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:29.874963 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:29.874963 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:29.874963 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:29.874963 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:29.874963 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:43:29.874963 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:29.874963 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 30 00:43:29.874963 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:29.877471 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 256/521] 10.222.0.40 () {56 vars in 1129 bytes} [Sun Oct 30 00:43:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:43:29.878286 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32b6ff-97ff-4b1d-a5e3-625d25d688a4 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:29.971768 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306e6e6-8671-473c-8bd1-eb6d1eb594f5 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:29.991568 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32b6ff-97ff-4b1d-a5e3-625d25d688a4 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:30.013574 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b3bf7-8511-464f-9a09-d19ea6289765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:30.014196 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b3bf7-8511-464f-9a09-d19ea6289765 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:30.014726 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:30.014935 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b3bf7-8511-464f-9a09-d19ea6289765 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:30.015721 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b3bf7-8511-464f-9a09-d19ea6289765 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:30.018252 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:30.025424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b3bf7-8511-464f-9a09-d19ea6289765 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:30.027397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b3bf7-8511-464f-9a09-d19ea6289765 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:30.031992 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba241c-25f6-4c0e-ac17-29ea0325de78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:30.032617 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba241c-25f6-4c0e-ac17-29ea0325de78 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:30.032891 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba241c-25f6-4c0e-ac17-29ea0325de78 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:30.033162 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba241c-25f6-4c0e-ac17-29ea0325de78 None admin] PATH_INFO: `/v3/services/network` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:30.033783 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba241c-25f6-4c0e-ac17-29ea0325de78 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:30.035144 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba241c-25f6-4c0e-ac17-29ea0325de78 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:30.040512 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-5d3b3bf7-8511-464f-9a09-d19ea6289765 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:30.040512 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:30.040512 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:30.040512 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:30.040512 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:30.040512 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:30.040512 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:30.040512 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:30.040512 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:30.040512 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:30.040512 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:30.040512 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:30.040512 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:43:30.040512 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:43:30.040512 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:43:30.041593 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:43:30.041593 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:30.041593 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:30.041593 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:30.041593 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:30.041593 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:30.041593 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:30.041593 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:30.041593 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:30.041593 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:30.041593 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:30.041593 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:30.041593 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:30.041593 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:30.041593 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:30.041593 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:30.041593 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:30.042603 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:43:30.042603 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:43:30.042603 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:43:30.042603 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:43:30.042603 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:43:30.042603 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:43:30.042603 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:30.042603 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:30.043975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-65ba241c-25f6-4c0e-ac17-29ea0325de78 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 30 00:43:30.043975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:30.043975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:43:30.043975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:43:30.043975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:43:30.043975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:43:30.043975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:43:30.043975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:30.043975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 30 00:43:30.043975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:30.043975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:43:30.043975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:30.043975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:30.043975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:30.043975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:30.043975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:30.043975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:30.044915 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:30.044915 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:30.044915 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:30.044915 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:30.044915 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:30.044915 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:30.044915 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:43:30.044915 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:43:30.044915 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:43:30.044915 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:43:30.044915 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:30.044915 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:30.044915 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:30.044915 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:30.044915 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:30.044915 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:30.045870 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:30.045870 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:30.045870 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:30.045870 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:30.045870 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:30.045870 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:30.045870 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:30.045870 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:30.045870 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:30.045870 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:30.045870 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:43:30.045870 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:30.045870 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 30 00:43:30.045870 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:30.045870 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 257/522] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:43:29 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:30.046785 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba241c-25f6-4c0e-ac17-29ea0325de78 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:30.047458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 266/523] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:43:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:30.057173 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b3bf7-8511-464f-9a09-d19ea6289765 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:30.168697 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b3bf7-8511-464f-9a09-d19ea6289765 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:30.184882 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba241c-25f6-4c0e-ac17-29ea0325de78 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:30.203250 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac96fc-8e09-4723-b437-588f07442e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:30.203892 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac96fc-8e09-4723-b437-588f07442e1a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:30.204155 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac96fc-8e09-4723-b437-588f07442e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:30.205231 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac96fc-8e09-4723-b437-588f07442e1a None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:30.205231 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac96fc-8e09-4723-b437-588f07442e1a None admin] RBAC: Adding query filter params (name=network) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:30.205471 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac96fc-8e09-4723-b437-588f07442e1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:30.206685 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac96fc-8e09-4723-b437-588f07442e1a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:30.211731 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 267/524] 10.222.0.40 () {56 vars in 1112 bytes} [Sun Oct 30 00:43:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:30.212132 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac96fc-8e09-4723-b437-588f07442e1a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:30.235221 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ab772-cafb-47b0-90ac-783051152352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:30.236086 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ab772-cafb-47b0-90ac-783051152352 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:30.236511 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ab772-cafb-47b0-90ac-783051152352 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:30.236927 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ab772-cafb-47b0-90ac-783051152352 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:30.238289 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ab772-cafb-47b0-90ac-783051152352 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:30.238888 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ab772-cafb-47b0-90ac-783051152352 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:30.240905 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ab772-cafb-47b0-90ac-783051152352 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:30.248152 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 258/525] 10.222.0.40 () {56 vars in 1124 bytes} [Sun Oct 30 00:43:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:30.249105 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ab772-cafb-47b0-90ac-783051152352 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:30.282341 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:30.316557 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:30.327171 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac96fc-8e09-4723-b437-588f07442e1a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:30.373315 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ccdfc6-0aff-4be7-b9a1-14514e5049fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:30.374510 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccdfc6-0aff-4be7-b9a1-14514e5049fd None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:30.375397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccdfc6-0aff-4be7-b9a1-14514e5049fd None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:30.376099 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccdfc6-0aff-4be7-b9a1-14514e5049fd None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:30.376979 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ccdfc6-0aff-4be7-b9a1-14514e5049fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:30.377490 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ccdfc6-0aff-4be7-b9a1-14514e5049fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:30.377917 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ab772-cafb-47b0-90ac-783051152352 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:30.379989 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ccdfc6-0aff-4be7-b9a1-14514e5049fd None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:30.400960 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 268/526] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Oct 30 00:43:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:30.402680 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ccdfc6-0aff-4be7-b9a1-14514e5049fd None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:30.427099 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981c27b-1f9d-4dd1-ac8f-ac2e2f4612a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:30.427704 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981c27b-1f9d-4dd1-ac8f-ac2e2f4612a9 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:30.427977 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981c27b-1f9d-4dd1-ac8f-ac2e2f4612a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:30.428243 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981c27b-1f9d-4dd1-ac8f-ac2e2f4612a9 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:30.428866 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981c27b-1f9d-4dd1-ac8f-ac2e2f4612a9 None admin] RBAC: Adding query filter params (type=network) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:30.429163 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981c27b-1f9d-4dd1-ac8f-ac2e2f4612a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:30.431384 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981c27b-1f9d-4dd1-ac8f-ac2e2f4612a9 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:30.445397 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 259/527] 10.222.0.40 () {56 vars in 1112 bytes} [Sun Oct 30 00:43:30 2022] GET /identity/v3/services?type=network => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:30.446373 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981c27b-1f9d-4dd1-ac8f-ac2e2f4612a9 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:30.578968 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ccdfc6-0aff-4be7-b9a1-14514e5049fd None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:30.625471 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:30.647967 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981c27b-1f9d-4dd1-ac8f-ac2e2f4612a9 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:30.654465 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06589d4a-2058-4c02-9687-8bc35715a1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:30.655078 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06589d4a-2058-4c02-9687-8bc35715a1ec None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:30.655348 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06589d4a-2058-4c02-9687-8bc35715a1ec None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:30.655612 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06589d4a-2058-4c02-9687-8bc35715a1ec None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:30.656230 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06589d4a-2058-4c02-9687-8bc35715a1ec None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:30.656523 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06589d4a-2058-4c02-9687-8bc35715a1ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:30.657902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06589d4a-2058-4c02-9687-8bc35715a1ec None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:30.663260 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:30.681638 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 269/528] 10.222.0.40 () {56 vars in 1124 bytes} [Sun Oct 30 00:43:30 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:30.688296 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5e41b-479a-4c29-b9d9-36b3ada1b2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:30.689315 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5e41b-479a-4c29-b9d9-36b3ada1b2a6 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:30.689901 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5e41b-479a-4c29-b9d9-36b3ada1b2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:30.690373 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5e41b-479a-4c29-b9d9-36b3ada1b2a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:30.691366 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5e41b-479a-4c29-b9d9-36b3ada1b2a6 None admin] RBAC: Adding query filter params (role.id=53b761158f744776b470f11e00bdaa81, scope.project.id=8969ed754fe24784a2025cbdbf6f1a8b, user.id=b996b01e045b4034be43a907536079c0) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:30.691907 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5e41b-479a-4c29-b9d9-36b3ada1b2a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:30.693705 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5e41b-479a-4c29-b9d9-36b3ada1b2a6 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:30.702314 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 260/529] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Oct 30 00:43:30 2022] GET /identity/v3/role_assignments?user.id=b996b01e045b4034be43a907536079c0&scope.project.id=8969ed754fe24784a2025cbdbf6f1a8b&role.id=53b761158f744776b470f11e00bdaa81 => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:31.158320 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f41da-c5a9-43ce-9f68-5e34d21653ea None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:31.159045 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f41da-c5a9-43ce-9f68-5e34d21653ea None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:31.159589 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f41da-c5a9-43ce-9f68-5e34d21653ea None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:31.161405 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 270/530] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:31.166365 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cd1f6-62cd-4f72-b834-228c1188ccd9 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:31.166865 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cd1f6-62cd-4f72-b834-228c1188ccd9 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:31.167351 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cd1f6-62cd-4f72-b834-228c1188ccd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:31.198200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-576cd1f6-62cd-4f72-b834-228c1188ccd9 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:31.200272 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-576cd1f6-62cd-4f72-b834-228c1188ccd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:31.289924 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 261/531] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:43:31.681755 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f41da-c5a9-43ce-9f68-5e34d21653ea None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:31.821146 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f41da-c5a9-43ce-9f68-5e34d21653ea None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:31.840895 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01544f2e-8561-451a-a290-8bdb83110e61 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:31.841468 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01544f2e-8561-451a-a290-8bdb83110e61 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:31.841468 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01544f2e-8561-451a-a290-8bdb83110e61 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:31.842937 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 262/532] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:31.848508 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5caa5-f1e1-4aee-aa15-e839f595803a None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:31.849060 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5caa5-f1e1-4aee-aa15-e839f595803a None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:31.849435 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5caa5-f1e1-4aee-aa15-e839f595803a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:31.857640 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5331a11-7dbe-4ca0-b954-caa57f444ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:31.858485 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5331a11-7dbe-4ca0-b954-caa57f444ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:31.858932 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5331a11-7dbe-4ca0-b954-caa57f444ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:31.859368 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5331a11-7dbe-4ca0-b954-caa57f444ff6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:31.869996 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5331a11-7dbe-4ca0-b954-caa57f444ff6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:43:31.870601 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-8dc5caa5-f1e1-4aee-aa15-e839f595803a None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:31.871904 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8dc5caa5-f1e1-4aee-aa15-e839f595803a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:31.875928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-f5331a11-7dbe-4ca0-b954-caa57f444ff6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:43:31.875928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:31.875928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:31.875928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:31.875928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:31.875928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:31.875928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:31.875928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:31.875928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:31.875928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:31.875928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:31.875928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:31.875928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:43:31.875928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:43:31.875928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:43:31.875928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:43:31.876839 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:43:31.876839 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:43:31.876839 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:43:31.876839 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:43:31.876839 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:31.876839 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:31.876839 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:31.876839 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:31.876839 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:31.876839 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:31.876839 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:31.876839 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:31.876839 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:31.876839 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:31.876839 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:31.876839 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:31.877707 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:31.877707 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:31.877707 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:31.877707 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:31.877707 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:43:31.877707 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:43:31.877707 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:43:31.877707 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:43:31.877707 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:43:31.877707 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:43:31.877707 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:43:31.877707 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:31.879932 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 271/533] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Oct 30 00:43:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:31.887767 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5331a11-7dbe-4ca0-b954-caa57f444ff6 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:31.953339 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:31.981213 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 263/534] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:43:32.039588 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5331a11-7dbe-4ca0-b954-caa57f444ff6 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:32.079361 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86482b-8bc6-474e-b287-64e4b3c4e974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:32.080016 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86482b-8bc6-474e-b287-64e4b3c4e974 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:32.080299 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86482b-8bc6-474e-b287-64e4b3c4e974 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:32.080570 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86482b-8bc6-474e-b287-64e4b3c4e974 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:32.081254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86482b-8bc6-474e-b287-64e4b3c4e974 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:32.081561 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86482b-8bc6-474e-b287-64e4b3c4e974 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:32.083009 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86482b-8bc6-474e-b287-64e4b3c4e974 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:32.097149 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 272/535] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:43:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:32.102751 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5caa5-f1e1-4aee-aa15-e839f595803a None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:32.142957 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:32.219231 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5caa5-f1e1-4aee-aa15-e839f595803a None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:32.264143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6967e-3548-4b73-a924-fbd15dddae0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:32.264839 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6967e-3548-4b73-a924-fbd15dddae0c None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:32.265117 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6967e-3548-4b73-a924-fbd15dddae0c None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:32.265406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6967e-3548-4b73-a924-fbd15dddae0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:32.280150 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6967e-3548-4b73-a924-fbd15dddae0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:32.281643 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6967e-3548-4b73-a924-fbd15dddae0c None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:32.301021 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-a2c6967e-3548-4b73-a924-fbd15dddae0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:32.301021 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:32.301021 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:32.301021 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:32.301021 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:32.301021 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:32.301021 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:32.301021 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:32.301021 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:32.301021 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:32.301021 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:32.301021 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:32.301021 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:32.301021 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:32.301021 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:32.301021 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:32.302023 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:32.302023 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:32.302023 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:32.302023 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:32.302023 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:32.302023 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:32.302023 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:32.302023 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:32.302023 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:32.302023 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:32.302023 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:32.302023 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:32.302023 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:32.302023 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:32.302023 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:32.302023 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:32.302023 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:32.302911 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:32.302911 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:32.302911 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:32.304840 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 264/536] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:32.307788 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86482b-8bc6-474e-b287-64e4b3c4e974 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:32.427976 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86482b-8bc6-474e-b287-64e4b3c4e974 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:32.431027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:32.470447 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4c971-09ee-4e97-a76f-fc64c3469c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:32.471075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4c971-09ee-4e97-a76f-fc64c3469c00 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:32.471368 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4c971-09ee-4e97-a76f-fc64c3469c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:32.471635 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4c971-09ee-4e97-a76f-fc64c3469c00 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:32.472268 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4c971-09ee-4e97-a76f-fc64c3469c00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:32.472566 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4c971-09ee-4e97-a76f-fc64c3469c00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:32.473953 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4c971-09ee-4e97-a76f-fc64c3469c00 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:32.486928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 273/537] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:32.494281 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6967e-3548-4b73-a924-fbd15dddae0c None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:32.524906 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4c971-09ee-4e97-a76f-fc64c3469c00 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:32.645565 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:32.682786 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6967e-3548-4b73-a924-fbd15dddae0c None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:32.702270 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4c971-09ee-4e97-a76f-fc64c3469c00 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:32.740333 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fde3b3-6cc8-4bb9-ba19-ac0243bb6bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:32.741294 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fde3b3-6cc8-4bb9-ba19-ac0243bb6bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:32.741766 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fde3b3-6cc8-4bb9-ba19-ac0243bb6bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:32.742241 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fde3b3-6cc8-4bb9-ba19-ac0243bb6bb0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:32.754055 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fde3b3-6cc8-4bb9-ba19-ac0243bb6bb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:43:32.759550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-08fde3b3-6cc8-4bb9-ba19-ac0243bb6bb0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:43:32.759550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:32.759550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:32.759550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:32.759550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:32.759550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:32.759550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:32.759550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:32.759550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:32.759550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:32.759550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:32.759550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:32.759550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:43:32.759550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:43:32.759550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:43:32.759550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:43:32.760456 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:43:32.760456 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:43:32.760456 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:43:32.760456 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:43:32.760456 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:32.760456 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:32.760456 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:32.760456 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:32.760456 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:32.760456 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:32.760456 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:32.760456 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:32.760456 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:32.760456 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:32.760456 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:32.760456 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:32.761325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:32.761325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:32.761325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:32.761325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:32.761325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:43:32.761325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:43:32.761325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:43:32.761325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:43:32.761325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:43:32.761325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:43:32.761325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:43:32.761325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:32.764129 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 274/538] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Oct 30 00:43:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:43:32.769521 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fde3b3-6cc8-4bb9-ba19-ac0243bb6bb0 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:32.787454 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9788d-311b-4554-aa14-1cab02f9b525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:32.788134 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9788d-311b-4554-aa14-1cab02f9b525 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:32.788410 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9788d-311b-4554-aa14-1cab02f9b525 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:32.788733 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9788d-311b-4554-aa14-1cab02f9b525 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:32.801594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9788d-311b-4554-aa14-1cab02f9b525 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:32.804551 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9788d-311b-4554-aa14-1cab02f9b525 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:32.818242 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:32.823061 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-a1b9788d-311b-4554-aa14-1cab02f9b525 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:43:32.823061 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:32.823061 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:32.823061 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:32.823061 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:32.823061 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:32.823061 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:32.823061 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:32.823061 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:32.823061 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:32.823061 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:32.823061 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:32.823061 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:43:32.823061 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:43:32.823061 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:43:32.823061 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:43:32.824505 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:32.824505 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:32.824505 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:43:32.824505 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:32.824505 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:43:32.824505 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:32.824505 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:32.824505 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:32.824505 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:32.824505 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:32.824505 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:32.824505 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:32.824505 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:32.824505 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:32.824505 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:32.824505 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:32.824505 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:32.824505 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:32.825472 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:32.825472 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:32.825472 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:43:32.825472 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:43:32.825472 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:43:32.825472 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:43:32.825472 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:43:32.825472 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:43:32.825472 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:43:32.825472 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:32.825472 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 265/539] 10.222.0.40 () {56 vars in 1093 bytes} [Sun Oct 30 00:43:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:32.832019 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9788d-311b-4554-aa14-1cab02f9b525 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:32.968386 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fde3b3-6cc8-4bb9-ba19-ac0243bb6bb0 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:32.976727 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9788d-311b-4554-aa14-1cab02f9b525 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:33.007085 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059420a-92c0-4eb9-a331-6dc28c1ad272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:33.007840 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059420a-92c0-4eb9-a331-6dc28c1ad272 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:33.008123 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059420a-92c0-4eb9-a331-6dc28c1ad272 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:33.008395 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059420a-92c0-4eb9-a331-6dc28c1ad272 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:33.009333 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059420a-92c0-4eb9-a331-6dc28c1ad272 None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:33.009548 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059420a-92c0-4eb9-a331-6dc28c1ad272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:33.010922 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059420a-92c0-4eb9-a331-6dc28c1ad272 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:33.019978 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 275/540] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Oct 30 00:43:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:33.021739 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364e5a5-3c8f-4ac9-9c58-07b4a59117ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:33.022576 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364e5a5-3c8f-4ac9-9c58-07b4a59117ab None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:33.023044 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364e5a5-3c8f-4ac9-9c58-07b4a59117ab None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:33.023500 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364e5a5-3c8f-4ac9-9c58-07b4a59117ab None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:33.024796 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364e5a5-3c8f-4ac9-9c58-07b4a59117ab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:33.025312 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364e5a5-3c8f-4ac9-9c58-07b4a59117ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:33.025675 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059420a-92c0-4eb9-a331-6dc28c1ad272 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:33.027816 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364e5a5-3c8f-4ac9-9c58-07b4a59117ab None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:33.049994 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 266/541] 10.222.0.40 () {56 vars in 1133 bytes} [Sun Oct 30 00:43:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:33.057110 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364e5a5-3c8f-4ac9-9c58-07b4a59117ab None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:33.070333 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:33.146722 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:33.165038 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059420a-92c0-4eb9-a331-6dc28c1ad272 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:33.196652 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364e5a5-3c8f-4ac9-9c58-07b4a59117ab None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:33.202128 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb5747-3163-422c-be0c-234183c7a9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:33.202815 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb5747-3163-422c-be0c-234183c7a9b9 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:33.203161 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb5747-3163-422c-be0c-234183c7a9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:33.203487 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb5747-3163-422c-be0c-234183c7a9b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:33.215707 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb5747-3163-422c-be0c-234183c7a9b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:33.217500 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb5747-3163-422c-be0c-234183c7a9b9 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:33.235254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-c8fb5747-3163-422c-be0c-234183c7a9b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:33.235254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:33.235254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:33.235254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:33.235254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:33.235254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:33.235254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:33.235254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:33.235254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:33.235254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:33.235254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:33.235254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:33.235254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:33.235254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:33.235254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:33.235254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:33.236515 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:33.236515 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:33.236515 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:33.236515 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:33.236515 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:33.236515 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:33.236515 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:33.236515 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:33.236515 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:33.236515 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:33.236515 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:33.236515 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:33.236515 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:33.236515 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:33.236515 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:33.236515 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:33.236515 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:33.238227 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:33.238227 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:33.238227 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:33.238227 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 276/542] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:33.238759 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613fdab-4b6d-4ec8-808a-9eb00753e7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:33.243427 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91ad5e-f172-403e-b7fc-290a58cf8482 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:33.243751 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613fdab-4b6d-4ec8-808a-9eb00753e7c6 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:33.243913 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91ad5e-f172-403e-b7fc-290a58cf8482 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:33.244065 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613fdab-4b6d-4ec8-808a-9eb00753e7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:33.244065 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613fdab-4b6d-4ec8-808a-9eb00753e7c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:33.244351 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91ad5e-f172-403e-b7fc-290a58cf8482 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:33.245745 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 277/543] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:33.246794 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91ad5e-f172-403e-b7fc-290a58cf8482 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:33.323357 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613fdab-4b6d-4ec8-808a-9eb00753e7c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:33.324774 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613fdab-4b6d-4ec8-808a-9eb00753e7c6 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:33.333566 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:33.365305 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91ad5e-f172-403e-b7fc-290a58cf8482 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:33.399761 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8cd618-4472-465d-aa11-31a6e3bd4f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:33.400325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cd618-4472-465d-aa11-31a6e3bd4f83 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:33.400602 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cd618-4472-465d-aa11-31a6e3bd4f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:33.400871 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cd618-4472-465d-aa11-31a6e3bd4f83 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:33.401586 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8cd618-4472-465d-aa11-31a6e3bd4f83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:33.401824 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8cd618-4472-465d-aa11-31a6e3bd4f83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:33.403766 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8cd618-4472-465d-aa11-31a6e3bd4f83 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:33.411642 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:33.422609 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 278/544] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:33.424588 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b91e6-8073-42bb-a287-2cedabb9002b None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:33.425326 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b91e6-8073-42bb-a287-2cedabb9002b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:33.425835 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b91e6-8073-42bb-a287-2cedabb9002b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:33.443722 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 267/545] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Oct 30 00:43:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:43:33.445942 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a56b91e6-8073-42bb-a287-2cedabb9002b None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:33.446860 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc637b7-5f7d-48e1-b9cf-f84983b6e8d8 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:33.447177 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a56b91e6-8073-42bb-a287-2cedabb9002b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:33.447588 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc637b7-5f7d-48e1-b9cf-f84983b6e8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:33.448118 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc637b7-5f7d-48e1-b9cf-f84983b6e8d8 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:33.450588 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 268/546] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:33.452534 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc637b7-5f7d-48e1-b9cf-f84983b6e8d8 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:33.517250 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 279/547] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:43:33.518093 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b91e6-8073-42bb-a287-2cedabb9002b None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:33.583043 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc637b7-5f7d-48e1-b9cf-f84983b6e8d8 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:33.590878 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:33.619747 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b91e6-8073-42bb-a287-2cedabb9002b None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:33.620565 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e459004-7d54-4f82-99cd-ceabbdd67453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:33.621251 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e459004-7d54-4f82-99cd-ceabbdd67453 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:33.621637 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e459004-7d54-4f82-99cd-ceabbdd67453 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:33.621903 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e459004-7d54-4f82-99cd-ceabbdd67453 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:33.629692 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e459004-7d54-4f82-99cd-ceabbdd67453 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:33.630900 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e459004-7d54-4f82-99cd-ceabbdd67453 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:33.642945 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-8e459004-7d54-4f82-99cd-ceabbdd67453 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 30 00:43:33.642945 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:33.642945 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:33.642945 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:33.642945 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:33.642945 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:33.642945 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:33.642945 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:33.642945 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:33.642945 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:33.642945 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:33.642945 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:33.642945 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:43:33.642945 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:43:33.642945 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:43:33.642945 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:43:33.643977 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:33.643977 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:33.643977 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:43:33.643977 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:33.643977 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:43:33.643977 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:33.643977 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:33.643977 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:33.643977 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:33.643977 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:33.643977 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:33.643977 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:33.643977 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:33.643977 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:33.643977 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:33.643977 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:33.643977 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:33.643977 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:33.644922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:33.644922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:33.644922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:43:33.644922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:43:33.644922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:43:33.644922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:43:33.644922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:43:33.644922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:43:33.644922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 30 00:43:33.644922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:33.644922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 269/548] 10.222.0.40 () {56 vars in 1117 bytes} [Sun Oct 30 00:43:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:33.646024 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a3b39-f796-40b8-a20a-7e13392e772b None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:33.646024 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a3b39-f796-40b8-a20a-7e13392e772b None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:33.646024 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a3b39-f796-40b8-a20a-7e13392e772b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:33.653702 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:33.661992 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45377b65-9444-4604-aaea-c6e7ec7a7896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:33.662624 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45377b65-9444-4604-aaea-c6e7ec7a7896 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:33.662908 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45377b65-9444-4604-aaea-c6e7ec7a7896 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:33.663203 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45377b65-9444-4604-aaea-c6e7ec7a7896 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:33.670615 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-968a3b39-f796-40b8-a20a-7e13392e772b None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:33.671814 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-968a3b39-f796-40b8-a20a-7e13392e772b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:33.673897 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45377b65-9444-4604-aaea-c6e7ec7a7896 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:33.675344 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45377b65-9444-4604-aaea-c6e7ec7a7896 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:33.691318 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-45377b65-9444-4604-aaea-c6e7ec7a7896 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:33.691318 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:33.691318 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:33.691318 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:33.691318 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:33.691318 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:33.691318 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:33.691318 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:33.691318 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:33.691318 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:33.691318 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:33.691318 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:33.691318 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:33.691318 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:33.691318 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:33.691318 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:33.692339 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:33.692339 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:33.692339 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:33.692339 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:33.692339 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:33.692339 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:33.692339 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:33.692339 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:33.692339 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:33.692339 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:33.692339 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:33.692339 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:33.692339 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:33.692339 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:33.692339 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:33.692339 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:33.692339 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:33.693263 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:33.693263 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:33.693263 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:33.693263 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 280/549] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:33.693553 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df39aa-f217-4586-899d-2b00b3e7acce None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:33.693831 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df39aa-f217-4586-899d-2b00b3e7acce None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:33.697231 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df39aa-f217-4586-899d-2b00b3e7acce None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:33.697231 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 281/550] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:33.697231 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df39aa-f217-4586-899d-2b00b3e7acce None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:33.747592 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 270/551] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:43:33.748513 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a3b39-f796-40b8-a20a-7e13392e772b None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:33.814436 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df39aa-f217-4586-899d-2b00b3e7acce None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:33.848155 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e2f6b-e8d8-4087-8b0b-6f6cd693ffea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:33.849021 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e2f6b-e8d8-4087-8b0b-6f6cd693ffea None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:33.849458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e2f6b-e8d8-4087-8b0b-6f6cd693ffea None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:33.849734 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e2f6b-e8d8-4087-8b0b-6f6cd693ffea None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:33.850459 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e2f6b-e8d8-4087-8b0b-6f6cd693ffea None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:33.850763 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e2f6b-e8d8-4087-8b0b-6f6cd693ffea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:33.852213 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e2f6b-e8d8-4087-8b0b-6f6cd693ffea None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:33.868043 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:33.868978 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 282/552] 10.222.0.40 () {56 vars in 1149 bytes} [Sun Oct 30 00:43:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:33.875314 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a3b39-f796-40b8-a20a-7e13392e772b None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:33.876489 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dd575-abf9-4b83-83c5-7f37a9472535 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:33.876997 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dd575-abf9-4b83-83c5-7f37a9472535 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:33.878200 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dd575-abf9-4b83-83c5-7f37a9472535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:33.896507 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-511dd575-abf9-4b83-83c5-7f37a9472535 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:33.897746 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-511dd575-abf9-4b83-83c5-7f37a9472535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:33.914238 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40a3e3-2288-4ce5-ba6b-f6e6756dfeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:33.914834 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40a3e3-2288-4ce5-ba6b-f6e6756dfeec None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:33.915272 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40a3e3-2288-4ce5-ba6b-f6e6756dfeec None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:33.915540 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40a3e3-2288-4ce5-ba6b-f6e6756dfeec None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:33.916477 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40a3e3-2288-4ce5-ba6b-f6e6756dfeec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:33.916776 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40a3e3-2288-4ce5-ba6b-f6e6756dfeec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:33.918202 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40a3e3-2288-4ce5-ba6b-f6e6756dfeec None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:33.927905 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:33.933107 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 271/553] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:33.934337 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40a3e3-2288-4ce5-ba6b-f6e6756dfeec None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:33.980649 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 283/554] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:43:33.980649 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511dd575-abf9-4b83-83c5-7f37a9472535 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:34.055217 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40a3e3-2288-4ce5-ba6b-f6e6756dfeec None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:34.086149 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511dd575-abf9-4b83-83c5-7f37a9472535 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:34.090938 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbd909-1034-412f-a593-450e33dee1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:34.091536 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbd909-1034-412f-a593-450e33dee1f4 None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:34.091814 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbd909-1034-412f-a593-450e33dee1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:34.092082 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbd909-1034-412f-a593-450e33dee1f4 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:34.092719 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efbd909-1034-412f-a593-450e33dee1f4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:34.094107 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efbd909-1034-412f-a593-450e33dee1f4 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:34.112791 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 272/555] 10.222.0.40 () {60 vars in 1141 bytes} [Sun Oct 30 00:43:33 2022] POST /identity/v3/services => generated 240 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:43:34.113561 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbd909-1034-412f-a593-450e33dee1f4 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:34.134248 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:34.146557 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbba69-cdd3-4f08-bfba-864e91ad1a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:34.148066 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbba69-cdd3-4f08-bfba-864e91ad1a24 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:34.148555 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbba69-cdd3-4f08-bfba-864e91ad1a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:34.149515 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbba69-cdd3-4f08-bfba-864e91ad1a24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:34.163958 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedbba69-cdd3-4f08-bfba-864e91ad1a24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:34.166424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedbba69-cdd3-4f08-bfba-864e91ad1a24 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:34.192902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-dedbba69-cdd3-4f08-bfba-864e91ad1a24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:34.192902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:34.192902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:34.192902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:34.192902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:34.192902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:34.192902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:34.192902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:34.192902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:34.192902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:34.192902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:34.192902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:34.192902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:34.192902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:34.192902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:34.192902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:34.193977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:34.193977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:34.193977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:34.193977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:34.193977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:34.193977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:34.193977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:34.193977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:34.193977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:34.193977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:34.193977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:34.193977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:34.193977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:34.193977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:34.193977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:34.193977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:34.193977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:34.194888 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:34.194888 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:34.194888 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:34.197429 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 284/556] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:34.198535 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbba69-cdd3-4f08-bfba-864e91ad1a24 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:34.224308 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:34.242432 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbd909-1034-412f-a593-450e33dee1f4 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:34.281066 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cecdd1d-aafb-439c-b05a-fd60c2f413d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:34.281880 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecdd1d-aafb-439c-b05a-fd60c2f413d3 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:34.282173 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecdd1d-aafb-439c-b05a-fd60c2f413d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:34.282445 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecdd1d-aafb-439c-b05a-fd60c2f413d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:34.290470 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cecdd1d-aafb-439c-b05a-fd60c2f413d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:34.291796 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cecdd1d-aafb-439c-b05a-fd60c2f413d3 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:34.304138 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-5cecdd1d-aafb-439c-b05a-fd60c2f413d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:34.304138 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:34.304138 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:34.304138 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:34.304138 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:34.304138 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:34.304138 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:34.304138 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:34.304138 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:34.304138 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:34.304138 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:34.304138 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:34.304138 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:43:34.304138 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:43:34.304138 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:43:34.305163 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:43:34.305163 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:34.305163 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:34.305163 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:34.305163 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:34.305163 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:34.305163 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:34.305163 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:34.305163 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:34.305163 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:34.305163 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:34.305163 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:34.305163 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:34.305163 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:34.305163 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:34.305163 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:34.305163 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:34.306197 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:43:34.306197 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:43:34.306197 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:43:34.306197 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:43:34.306197 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:43:34.306197 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:43:34.306197 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:34.306197 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:34.306197 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 273/557] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:43:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:34.306684 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cecdd1d-aafb-439c-b05a-fd60c2f413d3 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:34.326405 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbba69-cdd3-4f08-bfba-864e91ad1a24 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:34.361157 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb57c6a-37b7-4d94-80c3-185a58026d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:34.361774 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb57c6a-37b7-4d94-80c3-185a58026d73 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:34.362051 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb57c6a-37b7-4d94-80c3-185a58026d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:34.362319 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb57c6a-37b7-4d94-80c3-185a58026d73 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:34.363269 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb57c6a-37b7-4d94-80c3-185a58026d73 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:34.365175 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb57c6a-37b7-4d94-80c3-185a58026d73 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:34.380460 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 285/558] 10.222.0.40 () {60 vars in 1141 bytes} [Sun Oct 30 00:43:34 2022] POST /identity/v3/services => generated 251 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:43:34.381377 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb57c6a-37b7-4d94-80c3-185a58026d73 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:34.404384 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:34.432200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cecdd1d-aafb-439c-b05a-fd60c2f413d3 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:34.488883 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34efccf3-bc41-4cc4-9eb3-e439afe4e350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:34.490460 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efccf3-bc41-4cc4-9eb3-e439afe4e350 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:34.490792 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efccf3-bc41-4cc4-9eb3-e439afe4e350 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:34.491072 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efccf3-bc41-4cc4-9eb3-e439afe4e350 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:34.491723 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34efccf3-bc41-4cc4-9eb3-e439afe4e350 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:34.492023 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34efccf3-bc41-4cc4-9eb3-e439afe4e350 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:34.493510 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34efccf3-bc41-4cc4-9eb3-e439afe4e350 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:34.501579 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:34.508978 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 274/559] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:34.509900 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34efccf3-bc41-4cc4-9eb3-e439afe4e350 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:34.532622 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb57c6a-37b7-4d94-80c3-185a58026d73 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:34.581864 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515fbfc-59a7-46f4-8231-053ca21d8e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:34.582646 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515fbfc-59a7-46f4-8231-053ca21d8e9a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:34.582927 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515fbfc-59a7-46f4-8231-053ca21d8e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:34.583191 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515fbfc-59a7-46f4-8231-053ca21d8e9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:34.594971 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515fbfc-59a7-46f4-8231-053ca21d8e9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:43:34.599563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-c515fbfc-59a7-46f4-8231-053ca21d8e9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:43:34.599563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:34.599563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:34.599563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:34.599563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:34.599563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:34.599563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:34.599563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:34.599563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:34.599563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:34.599563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:34.599563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:34.599563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:43:34.599563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:43:34.599563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:43:34.599563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:43:34.600505 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:43:34.600505 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:43:34.600505 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:43:34.600505 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:43:34.600505 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:34.600505 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:34.600505 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:34.600505 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:34.600505 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:34.600505 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:34.600505 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:34.600505 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:34.600505 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:34.600505 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:34.600505 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:34.600505 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:34.601385 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:34.601385 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:34.601385 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:34.601385 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:34.601385 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:43:34.601385 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:43:34.601385 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:43:34.601385 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:43:34.601385 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:43:34.601385 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:43:34.601385 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:43:34.601385 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:34.601385 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 286/560] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Oct 30 00:43:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:34.602780 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515fbfc-59a7-46f4-8231-053ca21d8e9a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:34.653325 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34efccf3-bc41-4cc4-9eb3-e439afe4e350 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:34.694034 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:34.702168 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58dbba-512b-40cc-8cf4-fdd753c863b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:34.703105 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58dbba-512b-40cc-8cf4-fdd753c863b7 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:34.703579 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58dbba-512b-40cc-8cf4-fdd753c863b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:34.704514 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58dbba-512b-40cc-8cf4-fdd753c863b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:34.705486 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58dbba-512b-40cc-8cf4-fdd753c863b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:34.705984 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58dbba-512b-40cc-8cf4-fdd753c863b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:34.708331 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58dbba-512b-40cc-8cf4-fdd753c863b7 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:34.724497 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 275/561] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Oct 30 00:43:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:34.729759 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58dbba-512b-40cc-8cf4-fdd753c863b7 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:34.736552 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515fbfc-59a7-46f4-8231-053ca21d8e9a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:34.778952 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a85b9-f2a7-425a-a352-56ffa6dc063c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:34.779571 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a85b9-f2a7-425a-a352-56ffa6dc063c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:34.779845 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a85b9-f2a7-425a-a352-56ffa6dc063c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:34.780113 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a85b9-f2a7-425a-a352-56ffa6dc063c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:34.783229 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:34.789963 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a85b9-f2a7-425a-a352-56ffa6dc063c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:34.792140 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a85b9-f2a7-425a-a352-56ffa6dc063c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:34.806703 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-fa9a85b9-f2a7-425a-a352-56ffa6dc063c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:34.806703 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:34.806703 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:34.806703 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:34.806703 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:34.806703 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:34.806703 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:34.806703 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:34.806703 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:34.806703 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:34.806703 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:34.806703 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:34.806703 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:43:34.806703 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:43:34.806703 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:43:34.807630 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:43:34.807630 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:34.807630 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:34.807630 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:34.807630 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:34.807630 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:34.807630 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:34.807630 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:34.807630 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:34.807630 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:34.807630 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:34.807630 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:34.807630 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:34.807630 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:34.807630 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:34.807630 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:34.807630 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:34.809083 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:43:34.809083 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:43:34.809083 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:43:34.809083 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:43:34.809083 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:43:34.809083 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:43:34.809083 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:34.809083 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:34.809083 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 287/562] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:43:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:34.809604 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a85b9-f2a7-425a-a352-56ffa6dc063c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:34.867681 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58dbba-512b-40cc-8cf4-fdd753c863b7 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:34.918886 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8a5ad-19da-4250-9510-cdbcc51d3526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:34.919875 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8a5ad-19da-4250-9510-cdbcc51d3526 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:34.920346 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8a5ad-19da-4250-9510-cdbcc51d3526 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:34.920844 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8a5ad-19da-4250-9510-cdbcc51d3526 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:34.921902 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8a5ad-19da-4250-9510-cdbcc51d3526 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:34.922395 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8a5ad-19da-4250-9510-cdbcc51d3526 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:34.924198 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8a5ad-19da-4250-9510-cdbcc51d3526 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:34.937071 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 276/563] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:43:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:34.937467 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a85b9-f2a7-425a-a352-56ffa6dc063c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:34.938769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8a5ad-19da-4250-9510-cdbcc51d3526 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:34.980799 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831f462-598e-45a1-b8ee-2a7f344260d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:34.981423 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831f462-598e-45a1-b8ee-2a7f344260d4 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:34.981697 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831f462-598e-45a1-b8ee-2a7f344260d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:34.981958 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831f462-598e-45a1-b8ee-2a7f344260d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:34.982675 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831f462-598e-45a1-b8ee-2a7f344260d4 None admin] RBAC: Adding query filter params (role.id=17d0330d6df84d3091d7ef234dfc4e6b, scope.project.id=8969ed754fe24784a2025cbdbf6f1a8b, user.id=4237b425d9fa4a60b10802e5b108d542) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:34.982971 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831f462-598e-45a1-b8ee-2a7f344260d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:34.984390 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831f462-598e-45a1-b8ee-2a7f344260d4 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:34.997218 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 288/564] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Oct 30 00:43:34 2022] GET /identity/v3/role_assignments?user.id=4237b425d9fa4a60b10802e5b108d542&scope.project.id=8969ed754fe24784a2025cbdbf6f1a8b&role.id=17d0330d6df84d3091d7ef234dfc4e6b => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:34.997218 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831f462-598e-45a1-b8ee-2a7f344260d4 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:35.019325 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:35.116025 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8a5ad-19da-4250-9510-cdbcc51d3526 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:35.129576 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:35.158006 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1b608-a12a-4918-8264-caa215a303e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:35.158613 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1b608-a12a-4918-8264-caa215a303e3 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:35.158884 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1b608-a12a-4918-8264-caa215a303e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:35.159149 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1b608-a12a-4918-8264-caa215a303e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:35.159837 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1b608-a12a-4918-8264-caa215a303e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:35.160132 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1b608-a12a-4918-8264-caa215a303e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:35.162239 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1b608-a12a-4918-8264-caa215a303e3 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:35.177587 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 277/565] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Oct 30 00:43:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:35.181897 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1b608-a12a-4918-8264-caa215a303e3 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:35.204289 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831f462-598e-45a1-b8ee-2a7f344260d4 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:35.241225 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc3461-12fb-4622-8bc9-6e703058693a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:35.242009 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc3461-12fb-4622-8bc9-6e703058693a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:35.242291 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc3461-12fb-4622-8bc9-6e703058693a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:35.242563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc3461-12fb-4622-8bc9-6e703058693a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:35.255762 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc3461-12fb-4622-8bc9-6e703058693a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:35.257659 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc3461-12fb-4622-8bc9-6e703058693a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:35.275888 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-cdfc3461-12fb-4622-8bc9-6e703058693a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:35.275888 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:35.275888 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:35.275888 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:35.275888 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:35.275888 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:35.275888 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:35.275888 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:35.275888 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:35.275888 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:35.275888 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:35.275888 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:35.275888 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:35.275888 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:35.275888 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:35.275888 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:35.276860 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:35.276860 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:35.276860 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:35.276860 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:35.276860 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:35.276860 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:35.276860 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:35.276860 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:35.276860 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:35.276860 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:35.276860 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:35.276860 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:35.276860 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:35.276860 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:35.276860 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:35.276860 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:35.276860 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:35.278368 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:35.278368 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:35.278368 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:35.278368 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 289/566] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:35.284382 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc3461-12fb-4622-8bc9-6e703058693a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:35.294444 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1b608-a12a-4918-8264-caa215a303e3 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:35.312287 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:35.336114 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106bda8-debe-4957-8d60-c845990c6505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:35.336851 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106bda8-debe-4957-8d60-c845990c6505 None admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:35.337214 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106bda8-debe-4957-8d60-c845990c6505 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:35.337548 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106bda8-debe-4957-8d60-c845990c6505 None admin] PATH_INFO: `/v3/projects/8969ed754fe24784a2025cbdbf6f1a8b/users/c625c9434922494aa868f1a5511963f3/roles/53b761158f744776b470f11e00bdaa81` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:35.356628 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1106bda8-debe-4957-8d60-c845990c6505 None admin] RBAC: Authorizing `identity:create_grant(project_id=8969ed754fe24784a2025cbdbf6f1a8b, user_id=c625c9434922494aa868f1a5511963f3, role_id=53b761158f744776b470f11e00bdaa81)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:35.358228 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1106bda8-debe-4957-8d60-c845990c6505 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:35.376544 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 278/567] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Oct 30 00:43:35 2022] PUT /identity/v3/projects/8969ed754fe24784a2025cbdbf6f1a8b/users/c625c9434922494aa868f1a5511963f3/roles/53b761158f744776b470f11e00bdaa81 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:43:35.404141 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc3461-12fb-4622-8bc9-6e703058693a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:35.420263 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:35.446359 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5c8ef-f7a1-48f4-896f-01d0e4723d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:35.446888 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5c8ef-f7a1-48f4-896f-01d0e4723d2e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:35.447164 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5c8ef-f7a1-48f4-896f-01d0e4723d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:35.447433 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5c8ef-f7a1-48f4-896f-01d0e4723d2e None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:35.448080 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5c8ef-f7a1-48f4-896f-01d0e4723d2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:35.448375 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5c8ef-f7a1-48f4-896f-01d0e4723d2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:35.449876 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5c8ef-f7a1-48f4-896f-01d0e4723d2e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:35.464200 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 290/568] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:35.470319 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106bda8-debe-4957-8d60-c845990c6505 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:35.583720 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106bda8-debe-4957-8d60-c845990c6505 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:35.620992 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ddee0-bc4f-4d6b-b603-26a8f2a5c08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:35.622023 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ddee0-bc4f-4d6b-b603-26a8f2a5c08d None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:35.622500 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ddee0-bc4f-4d6b-b603-26a8f2a5c08d None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:35.622989 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ddee0-bc4f-4d6b-b603-26a8f2a5c08d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:35.631347 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ddee0-bc4f-4d6b-b603-26a8f2a5c08d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:35.633092 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ddee0-bc4f-4d6b-b603-26a8f2a5c08d None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:35.645705 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-6a4ddee0-bc4f-4d6b-b603-26a8f2a5c08d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 30 00:43:35.645705 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:35.645705 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:35.645705 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:35.645705 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:35.645705 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:35.645705 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:35.645705 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:35.645705 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:35.645705 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:35.645705 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:35.645705 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:35.645705 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:43:35.645705 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:43:35.645705 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:43:35.645705 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:43:35.646680 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:35.646680 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:35.646680 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:43:35.646680 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:35.646680 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:43:35.646680 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:35.646680 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:35.646680 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:35.646680 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:35.646680 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:35.646680 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:35.646680 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:35.646680 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:35.646680 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:35.646680 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:35.646680 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:35.646680 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:35.646680 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:35.647644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:35.647644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:35.647644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:43:35.647644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:43:35.647644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:43:35.647644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:43:35.647644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:43:35.647644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:43:35.647644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 30 00:43:35.647644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:35.650411 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 279/569] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Oct 30 00:43:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:35.660260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5c8ef-f7a1-48f4-896f-01d0e4723d2e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:35.786340 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5c8ef-f7a1-48f4-896f-01d0e4723d2e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:35.825931 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cd251-cd5a-4986-9316-042157eb90c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:35.826535 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cd251-cd5a-4986-9316-042157eb90c4 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:35.826850 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cd251-cd5a-4986-9316-042157eb90c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:35.827115 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cd251-cd5a-4986-9316-042157eb90c4 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:35.827837 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304cd251-cd5a-4986-9316-042157eb90c4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:35.828135 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304cd251-cd5a-4986-9316-042157eb90c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:35.829639 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304cd251-cd5a-4986-9316-042157eb90c4 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:35.852291 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 291/570] 10.222.0.40 () {56 vars in 1135 bytes} [Sun Oct 30 00:43:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:35.858229 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ddee0-bc4f-4d6b-b603-26a8f2a5c08d None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:35.898454 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:35.979498 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ddee0-bc4f-4d6b-b603-26a8f2a5c08d None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:36.023516 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331049b9-0cd8-4552-808d-3185238f808f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:36.024411 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331049b9-0cd8-4552-808d-3185238f808f None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:36.024696 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331049b9-0cd8-4552-808d-3185238f808f None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:36.024968 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331049b9-0cd8-4552-808d-3185238f808f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:36.035936 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331049b9-0cd8-4552-808d-3185238f808f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:36.041520 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331049b9-0cd8-4552-808d-3185238f808f None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:36.056310 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-331049b9-0cd8-4552-808d-3185238f808f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:36.056310 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:36.056310 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:36.056310 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:36.056310 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:36.056310 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:36.056310 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:36.056310 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:36.056310 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:36.056310 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:36.056310 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:36.056310 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:36.056310 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:36.056310 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:36.056310 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:36.056310 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:36.057392 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:36.057392 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:36.057392 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:36.057392 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:36.057392 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:36.057392 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:36.057392 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:36.057392 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:36.057392 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:36.057392 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:36.057392 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:36.057392 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:36.057392 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:36.057392 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:36.057392 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:36.057392 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:36.057392 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:36.059455 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:36.059455 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:36.059455 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:36.059455 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 280/571] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:36.063834 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cd251-cd5a-4986-9316-042157eb90c4 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:36.130647 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:36.252543 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cd251-cd5a-4986-9316-042157eb90c4 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:36.300024 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d9e53-1361-474c-a648-38b5693596d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:36.300612 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d9e53-1361-474c-a648-38b5693596d8 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:36.300895 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d9e53-1361-474c-a648-38b5693596d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:36.301164 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d9e53-1361-474c-a648-38b5693596d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:36.301818 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d9e53-1361-474c-a648-38b5693596d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:36.302117 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d9e53-1361-474c-a648-38b5693596d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:36.303478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d9e53-1361-474c-a648-38b5693596d8 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:36.315992 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 292/572] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:36.321339 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331049b9-0cd8-4552-808d-3185238f808f None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:36.483230 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:36.497724 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331049b9-0cd8-4552-808d-3185238f808f None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:36.538910 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb0326-f950-4c69-a63d-f765c34edec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:36.539548 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb0326-f950-4c69-a63d-f765c34edec9 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:36.539827 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb0326-f950-4c69-a63d-f765c34edec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:36.540098 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb0326-f950-4c69-a63d-f765c34edec9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:36.552417 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb0326-f950-4c69-a63d-f765c34edec9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:36.553898 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb0326-f950-4c69-a63d-f765c34edec9 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:36.565697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-adeb0326-f950-4c69-a63d-f765c34edec9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:36.565697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:36.565697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:36.565697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:36.565697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:36.565697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:36.565697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:36.565697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:36.565697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:36.565697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:36.565697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:36.565697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:36.565697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:43:36.565697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:43:36.565697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:43:36.566622 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:43:36.566622 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:36.566622 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:36.566622 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:36.566622 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:36.566622 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:36.566622 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:36.566622 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:36.566622 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:36.566622 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:36.566622 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:36.566622 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:36.566622 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:36.566622 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:36.566622 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:36.566622 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:36.566622 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:36.568095 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:43:36.568095 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:43:36.568095 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:43:36.568095 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:43:36.568095 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:43:36.568095 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:43:36.568095 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:36.568095 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:36.568095 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 281/573] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:43:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:36.574819 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d9e53-1361-474c-a648-38b5693596d8 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:36.614596 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfe53d-1977-4583-a2d3-ac9d22cd3556 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:36.614918 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfe53d-1977-4583-a2d3-ac9d22cd3556 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:36.615141 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfe53d-1977-4583-a2d3-ac9d22cd3556 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:36.616474 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 282/574] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:43:36.622584 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ec996-d594-41a1-9e20-1ccdd94da9aa None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:36.622868 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ec996-d594-41a1-9e20-1ccdd94da9aa None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:36.623152 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ec996-d594-41a1-9e20-1ccdd94da9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:36.650251 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-987ec996-d594-41a1-9e20-1ccdd94da9aa None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:36.651468 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-987ec996-d594-41a1-9e20-1ccdd94da9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:36.709492 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:36.731663 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d9e53-1361-474c-a648-38b5693596d8 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:36.785342 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 283/575] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:43:36.786803 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f0a64-5d9b-4be6-8221-d4e2d1fbba76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:36.787670 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f0a64-5d9b-4be6-8221-d4e2d1fbba76 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:36.788092 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f0a64-5d9b-4be6-8221-d4e2d1fbba76 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:36.788503 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f0a64-5d9b-4be6-8221-d4e2d1fbba76 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:36.789364 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f0a64-5d9b-4be6-8221-d4e2d1fbba76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:36.789807 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f0a64-5d9b-4be6-8221-d4e2d1fbba76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:36.791392 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f0a64-5d9b-4be6-8221-d4e2d1fbba76 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:36.804301 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 293/576] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Oct 30 00:43:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:36.810899 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ec996-d594-41a1-9e20-1ccdd94da9aa None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:36.877841 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:36.915030 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ec996-d594-41a1-9e20-1ccdd94da9aa None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:36.949910 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97789edd-ca9d-48bd-ba71-4d273a0fc0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:36.950564 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97789edd-ca9d-48bd-ba71-4d273a0fc0f8 None admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:36.950838 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97789edd-ca9d-48bd-ba71-4d273a0fc0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:36.951106 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97789edd-ca9d-48bd-ba71-4d273a0fc0f8 None admin] PATH_INFO: `/v3/projects/8969ed754fe24784a2025cbdbf6f1a8b/users/b996b01e045b4034be43a907536079c0/roles/17d0330d6df84d3091d7ef234dfc4e6b` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:36.952985 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97789edd-ca9d-48bd-ba71-4d273a0fc0f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=8969ed754fe24784a2025cbdbf6f1a8b, user_id=b996b01e045b4034be43a907536079c0, role_id=17d0330d6df84d3091d7ef234dfc4e6b)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:36.954489 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97789edd-ca9d-48bd-ba71-4d273a0fc0f8 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:36.970622 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 284/577] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Oct 30 00:43:36 2022] PUT /identity/v3/projects/8969ed754fe24784a2025cbdbf6f1a8b/users/b996b01e045b4034be43a907536079c0/roles/17d0330d6df84d3091d7ef234dfc4e6b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:43:37.014364 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00c053-a290-4e7b-9eea-6d662fa33535 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:37.015042 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00c053-a290-4e7b-9eea-6d662fa33535 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:37.015583 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00c053-a290-4e7b-9eea-6d662fa33535 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:37.017463 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 294/578] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:37.023453 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609b0ad-4dbe-4fac-9abd-aa0ea8425a7e None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:37.024338 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609b0ad-4dbe-4fac-9abd-aa0ea8425a7e None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:37.024809 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609b0ad-4dbe-4fac-9abd-aa0ea8425a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:37.054582 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-3609b0ad-4dbe-4fac-9abd-aa0ea8425a7e None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:37.056186 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-3609b0ad-4dbe-4fac-9abd-aa0ea8425a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:37.141765 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 285/579] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:43:37.176957 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00c053-a290-4e7b-9eea-6d662fa33535 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:37.283407 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00c053-a290-4e7b-9eea-6d662fa33535 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:37.317847 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced20158-1e2d-4b07-8bab-834e9aba8d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:37.318438 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced20158-1e2d-4b07-8bab-834e9aba8d33 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:37.318713 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced20158-1e2d-4b07-8bab-834e9aba8d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:37.318981 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced20158-1e2d-4b07-8bab-834e9aba8d33 None admin] PATH_INFO: `/v3/services/network` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:37.319599 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced20158-1e2d-4b07-8bab-834e9aba8d33 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:37.320959 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced20158-1e2d-4b07-8bab-834e9aba8d33 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:37.332210 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-ced20158-1e2d-4b07-8bab-834e9aba8d33 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 30 00:43:37.332210 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:37.332210 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:43:37.332210 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:43:37.332210 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:43:37.332210 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:43:37.332210 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:43:37.332210 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:37.332210 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 30 00:43:37.332210 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:37.332210 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:43:37.332210 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:37.332210 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:37.332210 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:37.332210 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:37.332210 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:37.332210 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:37.333214 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:37.333214 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:37.333214 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:37.333214 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:37.333214 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:37.333214 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:37.333214 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:43:37.333214 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:43:37.333214 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:43:37.333214 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:43:37.333214 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:37.333214 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:37.333214 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:37.333214 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:37.333214 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:37.333214 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:37.334719 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:37.334719 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:37.334719 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:37.334719 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:37.334719 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:37.334719 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:37.334719 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:37.334719 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:37.334719 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:37.334719 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:37.334719 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:43:37.334719 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:37.334719 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 30 00:43:37.334719 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:37.334719 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 295/580] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:43:37 2022] GET /identity/v3/services/network => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:37.339455 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609b0ad-4dbe-4fac-9abd-aa0ea8425a7e None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:37.409561 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:37.460118 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609b0ad-4dbe-4fac-9abd-aa0ea8425a7e None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:37.495153 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1283a-14bc-4c45-b264-23740ae94004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:37.496322 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1283a-14bc-4c45-b264-23740ae94004 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:37.496607 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1283a-14bc-4c45-b264-23740ae94004 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:37.496873 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1283a-14bc-4c45-b264-23740ae94004 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:37.497523 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1283a-14bc-4c45-b264-23740ae94004 None admin] RBAC: Adding query filter params (name=network) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:37.497817 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1283a-14bc-4c45-b264-23740ae94004 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:37.499170 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1283a-14bc-4c45-b264-23740ae94004 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:37.504374 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 286/581] 10.222.0.40 () {56 vars in 1112 bytes} [Sun Oct 30 00:43:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:37.509908 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced20158-1e2d-4b07-8bab-834e9aba8d33 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:37.533623 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:37.603654 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1283a-14bc-4c45-b264-23740ae94004 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:37.640402 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced20158-1e2d-4b07-8bab-834e9aba8d33 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:37.687119 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9143c0-daf4-4a8d-9777-292f9cf2463e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:37.687720 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9143c0-daf4-4a8d-9777-292f9cf2463e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:37.687988 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9143c0-daf4-4a8d-9777-292f9cf2463e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:37.688253 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9143c0-daf4-4a8d-9777-292f9cf2463e None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:37.689446 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9143c0-daf4-4a8d-9777-292f9cf2463e None admin] RBAC: Adding query filter params (type=network) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:37.689747 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9143c0-daf4-4a8d-9777-292f9cf2463e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:37.691111 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9143c0-daf4-4a8d-9777-292f9cf2463e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:37.703326 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 296/582] 10.222.0.40 () {56 vars in 1112 bytes} [Sun Oct 30 00:43:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:37.704693 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9143c0-daf4-4a8d-9777-292f9cf2463e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:37.747998 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1283a-14bc-4c45-b264-23740ae94004 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:37.774337 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:37.793486 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751e2a7-392a-4c31-9337-a31b3067b6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:37.794753 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751e2a7-392a-4c31-9337-a31b3067b6d3 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:37.795231 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751e2a7-392a-4c31-9337-a31b3067b6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:37.795710 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751e2a7-392a-4c31-9337-a31b3067b6d3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:37.796671 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751e2a7-392a-4c31-9337-a31b3067b6d3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:37.798275 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751e2a7-392a-4c31-9337-a31b3067b6d3 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:37.809005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-4751e2a7-392a-4c31-9337-a31b3067b6d3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 30 00:43:37.809005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:37.809005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:43:37.809005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:43:37.809005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:43:37.809005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:43:37.809005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:43:37.809005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:37.809005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 30 00:43:37.809005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:37.809005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:43:37.809005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:37.809005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:37.809005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:37.809005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:37.809005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:37.809005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:37.810119 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:37.810119 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:37.810119 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:37.810119 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:37.810119 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:37.810119 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:37.810119 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:43:37.810119 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:43:37.810119 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:43:37.810119 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:43:37.810119 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:37.810119 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:37.810119 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:37.810119 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:37.810119 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:37.810119 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:37.811087 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:37.811087 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:37.811087 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:37.811087 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:37.811087 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:37.811087 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:37.811087 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:37.811087 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:37.811087 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:37.811087 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:37.811087 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:43:37.811087 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:37.811087 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 30 00:43:37.811087 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:37.814392 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 287/583] 10.222.0.40 () {56 vars in 1129 bytes} [Sun Oct 30 00:43:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:43:37.825481 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751e2a7-392a-4c31-9337-a31b3067b6d3 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:37.865462 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:37.915240 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9143c0-daf4-4a8d-9777-292f9cf2463e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:37.965403 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3d24a-52d8-429f-8eb8-faa9c51f4d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:37.966008 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3d24a-52d8-429f-8eb8-faa9c51f4d58 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:37.966283 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3d24a-52d8-429f-8eb8-faa9c51f4d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:37.966551 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3d24a-52d8-429f-8eb8-faa9c51f4d58 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:37.967243 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f3d24a-52d8-429f-8eb8-faa9c51f4d58 None admin] RBAC: Adding query filter params (interface=public, service_id=2d8cb798d2674f99b4b5c94e34fbc26f, region_id=RegionOne) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:37.967544 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f3d24a-52d8-429f-8eb8-faa9c51f4d58 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:37.968899 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f3d24a-52d8-429f-8eb8-faa9c51f4d58 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:37.977269 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 297/584] 10.222.0.40 () {56 vars in 1251 bytes} [Sun Oct 30 00:43:37 2022] GET /identity/v3/endpoints?service_id=2d8cb798d2674f99b4b5c94e34fbc26f&interface=public®ion_id=RegionOne => generated 194 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:43:37.978658 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5f995-68b5-4eeb-bb01-baaa57cb8250 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:37.978942 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5f995-68b5-4eeb-bb01-baaa57cb8250 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:37.979208 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5f995-68b5-4eeb-bb01-baaa57cb8250 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:37.981382 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 298/585] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:37.983843 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5f995-68b5-4eeb-bb01-baaa57cb8250 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:38.003816 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751e2a7-392a-4c31-9337-a31b3067b6d3 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:38.044525 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5735b-9508-40bd-bd61-938d9acdd2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:38.045414 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5735b-9508-40bd-bd61-938d9acdd2d1 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:38.045988 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5735b-9508-40bd-bd61-938d9acdd2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:38.046327 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5735b-9508-40bd-bd61-938d9acdd2d1 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:38.047079 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5735b-9508-40bd-bd61-938d9acdd2d1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:38.047449 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5735b-9508-40bd-bd61-938d9acdd2d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:38.048929 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5735b-9508-40bd-bd61-938d9acdd2d1 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:38.063921 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 288/586] 10.222.0.40 () {56 vars in 1124 bytes} [Sun Oct 30 00:43:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:38.063921 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20aa50-34ed-4266-89c0-e638b0a1f07a None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:38.063921 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20aa50-34ed-4266-89c0-e638b0a1f07a None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:38.063921 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20aa50-34ed-4266-89c0-e638b0a1f07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:38.084809 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-5b20aa50-34ed-4266-89c0-e638b0a1f07a None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:38.086283 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-5b20aa50-34ed-4266-89c0-e638b0a1f07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:38.125976 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5f995-68b5-4eeb-bb01-baaa57cb8250 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:38.142524 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:38.177219 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 289/587] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:43:38.177219 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20aa50-34ed-4266-89c0-e638b0a1f07a None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:38.179435 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7ed59-24c5-4452-a7c9-f86638b5a51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:38.179889 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7ed59-24c5-4452-a7c9-f86638b5a51c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:38.181503 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7ed59-24c5-4452-a7c9-f86638b5a51c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:38.181796 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7ed59-24c5-4452-a7c9-f86638b5a51c None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:38.182423 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7ed59-24c5-4452-a7c9-f86638b5a51c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:38.184510 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7ed59-24c5-4452-a7c9-f86638b5a51c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:38.190238 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 299/588] 10.222.0.40 () {56 vars in 1087 bytes} [Sun Oct 30 00:43:37 2022] GET /identity/v3/services => generated 772 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:38.191538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dbd75-66c3-4acc-a690-4e1e39b52681 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:38.191822 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dbd75-66c3-4acc-a690-4e1e39b52681 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:38.192092 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dbd75-66c3-4acc-a690-4e1e39b52681 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:38.198047 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 300/589] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:38.199514 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21274ef8-e2dd-43bb-86eb-07c62f0e8648 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:38.199790 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21274ef8-e2dd-43bb-86eb-07c62f0e8648 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:38.200056 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21274ef8-e2dd-43bb-86eb-07c62f0e8648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:38.216120 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:38.221227 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-21274ef8-e2dd-43bb-86eb-07c62f0e8648 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:38.221227 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-21274ef8-e2dd-43bb-86eb-07c62f0e8648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:38.319723 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20aa50-34ed-4266-89c0-e638b0a1f07a None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:38.352558 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 301/590] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:43:38.374546 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813b16a-e8e7-402d-a575-bfa2ea7ca28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:38.375228 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813b16a-e8e7-402d-a575-bfa2ea7ca28c None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:38.375445 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813b16a-e8e7-402d-a575-bfa2ea7ca28c None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:38.375713 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813b16a-e8e7-402d-a575-bfa2ea7ca28c None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:38.376403 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813b16a-e8e7-402d-a575-bfa2ea7ca28c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:38.376645 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813b16a-e8e7-402d-a575-bfa2ea7ca28c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:38.378042 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813b16a-e8e7-402d-a575-bfa2ea7ca28c None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:38.383781 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 290/591] 10.222.0.40 () {56 vars in 1124 bytes} [Sun Oct 30 00:43:38 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:38.389541 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21274ef8-e2dd-43bb-86eb-07c62f0e8648 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:38.492487 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21274ef8-e2dd-43bb-86eb-07c62f0e8648 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:38.528209 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b77c9-52b7-48d7-88d1-e865243f9457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:38.528823 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b77c9-52b7-48d7-88d1-e865243f9457 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:38.529101 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b77c9-52b7-48d7-88d1-e865243f9457 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:38.529405 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b77c9-52b7-48d7-88d1-e865243f9457 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:38.530104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b77c9-52b7-48d7-88d1-e865243f9457 None admin] RBAC: Adding query filter params (interface=public, service_id=f394d47a95cd4c1fb2b2dce404ee8fab, region_id=RegionOne) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:38.530410 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b77c9-52b7-48d7-88d1-e865243f9457 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:38.532660 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813b16a-e8e7-402d-a575-bfa2ea7ca28c None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:38.533164 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b77c9-52b7-48d7-88d1-e865243f9457 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:38.540019 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 302/592] 10.222.0.40 () {56 vars in 1251 bytes} [Sun Oct 30 00:43:38 2022] GET /identity/v3/endpoints?service_id=f394d47a95cd4c1fb2b2dce404ee8fab&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:38.541515 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:38.548992 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b77c9-52b7-48d7-88d1-e865243f9457 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:38.597616 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:38.687780 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b77c9-52b7-48d7-88d1-e865243f9457 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:38.699098 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813b16a-e8e7-402d-a575-bfa2ea7ca28c None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:38.725387 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306ea58-ce39-4051-9ed8-a423e2abfc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:38.726369 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306ea58-ce39-4051-9ed8-a423e2abfc7d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:38.726906 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306ea58-ce39-4051-9ed8-a423e2abfc7d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:38.727420 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306ea58-ce39-4051-9ed8-a423e2abfc7d None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:38.728310 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7306ea58-ce39-4051-9ed8-a423e2abfc7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:38.729877 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7306ea58-ce39-4051-9ed8-a423e2abfc7d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:38.738634 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 303/593] 10.222.0.40 () {56 vars in 1087 bytes} [Sun Oct 30 00:43:38 2022] GET /identity/v3/services => generated 772 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:38.739472 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306ea58-ce39-4051-9ed8-a423e2abfc7d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:38.740384 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f530c6-2c54-4383-bc97-bc8145588a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:38.741324 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f530c6-2c54-4383-bc97-bc8145588a1e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:38.741912 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f530c6-2c54-4383-bc97-bc8145588a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:38.742381 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f530c6-2c54-4383-bc97-bc8145588a1e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:38.743287 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f530c6-2c54-4383-bc97-bc8145588a1e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:38.744892 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f530c6-2c54-4383-bc97-bc8145588a1e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:38.756916 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-f6f530c6-2c54-4383-bc97-bc8145588a1e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 30 00:43:38.756916 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:38.756916 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:43:38.756916 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:43:38.756916 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:43:38.756916 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:43:38.756916 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:43:38.756916 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:38.756916 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 30 00:43:38.756916 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:38.756916 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:43:38.756916 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:38.756916 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:38.756916 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:38.756916 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:38.756916 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:38.758029 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:38.758029 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:38.758029 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:38.758029 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:38.758029 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:38.758029 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:38.758029 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:38.758029 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:43:38.758029 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:43:38.758029 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:43:38.758029 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:43:38.758029 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:38.758029 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:38.758029 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:38.758029 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:38.758029 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:38.758029 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:38.758914 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:38.758914 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:38.758914 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:38.758914 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:38.758914 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:38.758914 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:38.758914 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:38.758914 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:38.758914 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:38.758914 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:38.758914 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:43:38.758914 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:38.758914 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 30 00:43:38.758914 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:38.761921 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 291/594] 10.222.0.40 () {56 vars in 1132 bytes} [Sun Oct 30 00:43:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:43:38.767650 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f530c6-2c54-4383-bc97-bc8145588a1e None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:38.807914 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:38.848195 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306ea58-ce39-4051-9ed8-a423e2abfc7d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:38.886840 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38841c1b-939e-4b2c-9e4c-9f12e7798197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:38.887455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38841c1b-939e-4b2c-9e4c-9f12e7798197 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:38.887728 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38841c1b-939e-4b2c-9e4c-9f12e7798197 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:38.887995 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38841c1b-939e-4b2c-9e4c-9f12e7798197 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:38.899453 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38841c1b-939e-4b2c-9e4c-9f12e7798197 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:43:38.901230 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f530c6-2c54-4383-bc97-bc8145588a1e None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:38.905035 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-38841c1b-939e-4b2c-9e4c-9f12e7798197 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:43:38.905035 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:38.905035 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:38.905035 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:38.905035 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:38.905035 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:38.905035 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:38.905035 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:38.905035 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:38.905035 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:38.905035 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:38.905035 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:38.905035 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:43:38.905035 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:43:38.905035 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:43:38.905035 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:43:38.910867 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:43:38.910867 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:43:38.910867 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:43:38.910867 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:43:38.910867 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:38.910867 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:38.910867 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:38.910867 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:38.910867 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:38.910867 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:38.910867 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:38.910867 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:38.910867 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:38.910867 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:38.910867 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:38.910867 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:38.911734 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:38.911734 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:38.911734 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:38.911734 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:38.911734 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:43:38.911734 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:43:38.911734 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:43:38.911734 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:43:38.911734 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:43:38.911734 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:43:38.911734 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:43:38.911734 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:38.911734 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 304/595] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Oct 30 00:43:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:38.914002 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38841c1b-939e-4b2c-9e4c-9f12e7798197 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:38.915650 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:38.953663 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359f0d6-e6db-4b4c-ad9a-27610851521b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:38.954677 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359f0d6-e6db-4b4c-ad9a-27610851521b None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:38.955224 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359f0d6-e6db-4b4c-ad9a-27610851521b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:38.955709 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359f0d6-e6db-4b4c-ad9a-27610851521b None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:38.956867 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359f0d6-e6db-4b4c-ad9a-27610851521b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:38.957428 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359f0d6-e6db-4b4c-ad9a-27610851521b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:38.959178 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359f0d6-e6db-4b4c-ad9a-27610851521b None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:38.966758 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 292/596] 10.222.0.40 () {56 vars in 1126 bytes} [Sun Oct 30 00:43:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:43:38.977398 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359f0d6-e6db-4b4c-ad9a-27610851521b None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:39.070914 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38841c1b-939e-4b2c-9e4c-9f12e7798197 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:39.095421 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:39.107070 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42049ab-bb42-41a7-95b8-e161615a0a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:39.107584 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42049ab-bb42-41a7-95b8-e161615a0a0e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:39.107858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42049ab-bb42-41a7-95b8-e161615a0a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:39.108122 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42049ab-bb42-41a7-95b8-e161615a0a0e None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:39.108786 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42049ab-bb42-41a7-95b8-e161615a0a0e None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:39.109312 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42049ab-bb42-41a7-95b8-e161615a0a0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:39.110497 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42049ab-bb42-41a7-95b8-e161615a0a0e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:39.112592 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359f0d6-e6db-4b4c-ad9a-27610851521b None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:39.123924 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 305/597] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Oct 30 00:43:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:43:39.126515 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42049ab-bb42-41a7-95b8-e161615a0a0e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:39.155984 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368bcb1-1ad8-4c67-b740-e99a1a5d2357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:39.157040 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368bcb1-1ad8-4c67-b740-e99a1a5d2357 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:39.157532 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368bcb1-1ad8-4c67-b740-e99a1a5d2357 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:39.158261 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368bcb1-1ad8-4c67-b740-e99a1a5d2357 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:39.159170 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368bcb1-1ad8-4c67-b740-e99a1a5d2357 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:39.159886 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368bcb1-1ad8-4c67-b740-e99a1a5d2357 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:39.161452 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368bcb1-1ad8-4c67-b740-e99a1a5d2357 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:39.167163 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 293/598] 10.222.0.40 () {56 vars in 1126 bytes} [Sun Oct 30 00:43:38 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:39.237211 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42049ab-bb42-41a7-95b8-e161615a0a0e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:39.275090 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfb2a3-6d6b-4494-99cf-85e5aedc5539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:39.275859 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfb2a3-6d6b-4494-99cf-85e5aedc5539 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:39.276137 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfb2a3-6d6b-4494-99cf-85e5aedc5539 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:39.276409 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfb2a3-6d6b-4494-99cf-85e5aedc5539 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:39.288382 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cfb2a3-6d6b-4494-99cf-85e5aedc5539 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:39.289869 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cfb2a3-6d6b-4494-99cf-85e5aedc5539 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:39.305413 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-e7cfb2a3-6d6b-4494-99cf-85e5aedc5539 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:39.305413 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:39.305413 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:39.305413 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:39.305413 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:39.305413 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:39.305413 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:39.305413 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:39.305413 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:39.305413 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:39.305413 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:39.305413 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:39.305413 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:39.305413 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:39.305413 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:39.305413 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:39.306424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:39.306424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:39.306424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:39.306424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:39.306424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:39.306424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:39.306424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:39.306424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:39.306424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:39.306424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:39.306424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:39.306424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:39.306424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:39.306424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:39.306424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:39.306424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:39.306424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:39.307603 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:39.307603 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:39.307603 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:39.307603 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 306/599] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:43:39.314463 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368bcb1-1ad8-4c67-b740-e99a1a5d2357 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:39.388205 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:39.470695 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368bcb1-1ad8-4c67-b740-e99a1a5d2357 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:39.506036 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335e098-22c9-46f2-be9d-c08e39defa7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:39.507060 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335e098-22c9-46f2-be9d-c08e39defa7a None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:39.507536 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335e098-22c9-46f2-be9d-c08e39defa7a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:39.508046 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335e098-22c9-46f2-be9d-c08e39defa7a None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:39.508956 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335e098-22c9-46f2-be9d-c08e39defa7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:39.509534 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335e098-22c9-46f2-be9d-c08e39defa7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:39.511162 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335e098-22c9-46f2-be9d-c08e39defa7a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:39.529270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 294/600] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:39.532977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfb2a3-6d6b-4494-99cf-85e5aedc5539 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:39.603751 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:39.650463 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d1010-5db2-4916-848a-444c36d9dfa3 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:39.651076 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d1010-5db2-4916-848a-444c36d9dfa3 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:39.651538 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d1010-5db2-4916-848a-444c36d9dfa3 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:39.655858 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 295/601] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:43:39.661794 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ed3be-75e5-4345-b290-55f1221080ca None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:39.662082 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ed3be-75e5-4345-b290-55f1221080ca None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:39.662612 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ed3be-75e5-4345-b290-55f1221080ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:39.695375 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfb2a3-6d6b-4494-99cf-85e5aedc5539 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:39.698372 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-ce6ed3be-75e5-4345-b290-55f1221080ca None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:39.701214 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ce6ed3be-75e5-4345-b290-55f1221080ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:39.759670 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5860902-bea2-4510-9eb7-a721a9e6ac4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:39.761737 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5860902-bea2-4510-9eb7-a721a9e6ac4a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:39.762199 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5860902-bea2-4510-9eb7-a721a9e6ac4a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:39.762802 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5860902-bea2-4510-9eb7-a721a9e6ac4a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:39.782787 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5860902-bea2-4510-9eb7-a721a9e6ac4a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:39.784488 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5860902-bea2-4510-9eb7-a721a9e6ac4a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:39.797539 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 296/602] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:43:39.802478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-c5860902-bea2-4510-9eb7-a721a9e6ac4a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 30 00:43:39.802478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:39.802478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:39.802478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:39.802478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:39.802478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:39.802478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:39.802478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:39.802478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:39.802478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:39.802478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:39.802478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:39.802478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:43:39.802478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:43:39.802478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:43:39.802478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:43:39.803438 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:39.803438 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:39.803438 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:43:39.803438 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:39.803438 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:43:39.803438 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:39.803438 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:39.803438 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:39.803438 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:39.803438 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:39.803438 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:39.803438 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:39.803438 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:39.803438 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:39.803438 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:39.803438 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:39.803438 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:39.803438 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:39.804423 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:39.804423 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:39.804423 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:43:39.804423 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:43:39.804423 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:43:39.804423 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:43:39.804423 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:43:39.804423 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:43:39.804423 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 30 00:43:39.804423 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:39.808128 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 307/603] 10.222.0.40 () {56 vars in 1117 bytes} [Sun Oct 30 00:43:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:39.809963 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ed3be-75e5-4345-b290-55f1221080ca None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:39.837603 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:39.911975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ed3be-75e5-4345-b290-55f1221080ca None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:39.948387 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f85ddf-b6e9-4808-8b1a-b8461be3ca39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:39.949134 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f85ddf-b6e9-4808-8b1a-b8461be3ca39 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:39.949338 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f85ddf-b6e9-4808-8b1a-b8461be3ca39 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:39.949578 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f85ddf-b6e9-4808-8b1a-b8461be3ca39 None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:39.950301 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f85ddf-b6e9-4808-8b1a-b8461be3ca39 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:39.950592 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f85ddf-b6e9-4808-8b1a-b8461be3ca39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:39.952016 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f85ddf-b6e9-4808-8b1a-b8461be3ca39 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:39.975163 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 297/604] 10.222.0.40 () {56 vars in 1149 bytes} [Sun Oct 30 00:43:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:39.976491 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5860902-bea2-4510-9eb7-a721a9e6ac4a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:40.082917 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:40.087065 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5860902-bea2-4510-9eb7-a721a9e6ac4a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:40.132220 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd0546-6d4d-49bf-b3d4-77faf473e618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:40.132828 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd0546-6d4d-49bf-b3d4-77faf473e618 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:40.133100 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd0546-6d4d-49bf-b3d4-77faf473e618 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:40.133401 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd0546-6d4d-49bf-b3d4-77faf473e618 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:40.216805 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd0546-6d4d-49bf-b3d4-77faf473e618 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:40.218301 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd0546-6d4d-49bf-b3d4-77faf473e618 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:40.341940 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:40.345160 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f85ddf-b6e9-4808-8b1a-b8461be3ca39 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:40.347609 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 308/605] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Oct 30 00:43:39 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 30 00:43:40.362633 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd0546-6d4d-49bf-b3d4-77faf473e618 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:40.441576 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:40.461784 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f85ddf-b6e9-4808-8b1a-b8461be3ca39 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:40.497961 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60200dad-ab98-4ebe-930f-febb1728efa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:40.498586 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60200dad-ab98-4ebe-930f-febb1728efa7 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:40.498857 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60200dad-ab98-4ebe-930f-febb1728efa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:40.499124 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60200dad-ab98-4ebe-930f-febb1728efa7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:40.509589 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60200dad-ab98-4ebe-930f-febb1728efa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:43:40.514461 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-60200dad-ab98-4ebe-930f-febb1728efa7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:43:40.514461 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:40.514461 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:40.514461 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:40.514461 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:40.514461 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:40.514461 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:40.514461 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:40.514461 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:40.514461 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:40.514461 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:40.514461 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:40.514461 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:43:40.514461 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:43:40.514461 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:43:40.514461 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:43:40.515394 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:43:40.515394 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:43:40.515394 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:43:40.515394 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:43:40.515394 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:40.515394 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:40.515394 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:40.515394 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:40.515394 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:40.515394 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:40.515394 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:40.515394 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:40.515394 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:40.515394 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:40.515394 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:40.515394 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:40.516271 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:40.516271 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:40.516271 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:40.516271 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:40.516271 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:43:40.516271 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:43:40.516271 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:43:40.516271 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:43:40.516271 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:43:40.516271 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:43:40.516271 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:43:40.516271 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:40.516271 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 298/606] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Oct 30 00:43:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:40.521408 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60200dad-ab98-4ebe-930f-febb1728efa7 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:40.560162 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd0546-6d4d-49bf-b3d4-77faf473e618 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:40.624778 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4724f0c-8207-464e-8af2-69ab8d350279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:40.625358 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4724f0c-8207-464e-8af2-69ab8d350279 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:40.625637 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4724f0c-8207-464e-8af2-69ab8d350279 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:40.625907 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4724f0c-8207-464e-8af2-69ab8d350279 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:40.644020 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4724f0c-8207-464e-8af2-69ab8d350279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:40.645489 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4724f0c-8207-464e-8af2-69ab8d350279 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:40.663759 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60200dad-ab98-4ebe-930f-febb1728efa7 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:40.678367 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-e4724f0c-8207-464e-8af2-69ab8d350279 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:40.678367 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:40.678367 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:40.678367 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:40.678367 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:40.678367 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:40.678367 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:40.678367 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:40.678367 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:40.678367 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:40.678367 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:40.678367 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:40.678367 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:40.678367 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:40.678367 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:40.678367 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:40.679544 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:40.679544 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:40.679544 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:40.679544 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:40.679544 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:40.679544 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:40.679544 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:40.679544 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:40.679544 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:40.679544 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:40.679544 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:40.679544 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:40.679544 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:40.679544 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:40.679544 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:40.679544 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:40.679544 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:40.680753 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:40.680753 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:40.680753 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:40.693218 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 309/607] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:43:40.699463 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4724f0c-8207-464e-8af2-69ab8d350279 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:40.710243 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b9d7a-2914-4f3f-8813-b216271c51cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:40.711075 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b9d7a-2914-4f3f-8813-b216271c51cf None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:40.711548 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b9d7a-2914-4f3f-8813-b216271c51cf None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:40.711991 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b9d7a-2914-4f3f-8813-b216271c51cf None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:40.712809 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b9d7a-2914-4f3f-8813-b216271c51cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:40.713298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b9d7a-2914-4f3f-8813-b216271c51cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:40.715527 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b9d7a-2914-4f3f-8813-b216271c51cf None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:40.724503 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 299/608] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:43:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:40.733025 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b9d7a-2914-4f3f-8813-b216271c51cf None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:40.734044 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:40.795111 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:40.876667 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4724f0c-8207-464e-8af2-69ab8d350279 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:40.935244 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b9d7a-2914-4f3f-8813-b216271c51cf None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:40.936715 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa684e-9cdb-4bf3-962e-98e428096c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:40.937434 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa684e-9cdb-4bf3-962e-98e428096c62 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:40.937722 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa684e-9cdb-4bf3-962e-98e428096c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:40.937995 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa684e-9cdb-4bf3-962e-98e428096c62 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:40.938649 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa684e-9cdb-4bf3-962e-98e428096c62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:40.938954 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa684e-9cdb-4bf3-962e-98e428096c62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:40.940323 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa684e-9cdb-4bf3-962e-98e428096c62 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:40.961449 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 310/609] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:43:40.970144 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa684e-9cdb-4bf3-962e-98e428096c62 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:40.970311 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3503982-6f26-4438-b9a3-cefe4d9949c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:40.970798 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3503982-6f26-4438-b9a3-cefe4d9949c8 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:40.971069 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3503982-6f26-4438-b9a3-cefe4d9949c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:40.971337 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3503982-6f26-4438-b9a3-cefe4d9949c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:40.983137 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3503982-6f26-4438-b9a3-cefe4d9949c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:40.984606 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3503982-6f26-4438-b9a3-cefe4d9949c8 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:40.999674 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-b3503982-6f26-4438-b9a3-cefe4d9949c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:40.999674 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:40.999674 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:40.999674 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:40.999674 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:40.999674 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:40.999674 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:40.999674 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:40.999674 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:40.999674 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:40.999674 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:40.999674 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:40.999674 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:40.999674 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:40.999674 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:40.999674 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:41.000667 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:41.000667 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:41.000667 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:41.000667 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:41.000667 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:41.000667 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:41.000667 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:41.000667 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:41.000667 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:41.000667 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:41.000667 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:41.000667 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:41.000667 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:41.000667 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:41.000667 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:41.000667 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:41.000667 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:41.002179 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:41.002179 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:41.002179 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:41.002179 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 300/610] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:41.006419 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3503982-6f26-4438-b9a3-cefe4d9949c8 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:41.097627 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:41.113453 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa684e-9cdb-4bf3-962e-98e428096c62 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:41.114923 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3503982-6f26-4438-b9a3-cefe4d9949c8 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:41.125329 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:41.150352 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665039f-f9a9-47fc-908f-8bb6fb3d2d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:41.150995 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665039f-f9a9-47fc-908f-8bb6fb3d2d6c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:41.151341 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665039f-f9a9-47fc-908f-8bb6fb3d2d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:41.151687 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665039f-f9a9-47fc-908f-8bb6fb3d2d6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:41.153536 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efd847-8b63-49d4-a352-e68639e4fe65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:41.154250 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efd847-8b63-49d4-a352-e68639e4fe65 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:41.154659 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efd847-8b63-49d4-a352-e68639e4fe65 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:41.154989 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efd847-8b63-49d4-a352-e68639e4fe65 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:41.155685 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9efd847-8b63-49d4-a352-e68639e4fe65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:41.156044 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9efd847-8b63-49d4-a352-e68639e4fe65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:41.157541 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9efd847-8b63-49d4-a352-e68639e4fe65 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:41.159171 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9665039f-f9a9-47fc-908f-8bb6fb3d2d6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:41.160673 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9665039f-f9a9-47fc-908f-8bb6fb3d2d6c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:41.170881 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 301/611] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:43:41.172297 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804866e-f60b-4dcf-9ae3-8463f2994147 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:41.172635 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804866e-f60b-4dcf-9ae3-8463f2994147 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:41.172966 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804866e-f60b-4dcf-9ae3-8463f2994147 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:41.173306 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-9665039f-f9a9-47fc-908f-8bb6fb3d2d6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:41.173306 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:41.173306 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:41.173306 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:41.173306 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:41.173306 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:41.173306 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:41.173306 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:41.173306 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:41.173306 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:41.173306 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:41.173306 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:41.173306 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:43:41.173306 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:43:41.173306 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:43:41.174345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:43:41.174345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:41.174345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:41.174345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:41.174345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:41.174345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:41.174345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:41.174345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:41.174345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:41.174345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:41.174345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:41.174345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:41.174345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:41.174345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:41.174345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:41.174345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:41.174345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:41.175919 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:43:41.175919 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:43:41.175919 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:43:41.175919 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:43:41.175919 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:43:41.175919 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:43:41.175919 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:41.175919 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:41.176654 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 302/612] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:41.176654 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804866e-f60b-4dcf-9ae3-8463f2994147 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:41.180311 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 311/613] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:43:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:41.181626 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e29a46-c792-454e-8314-05c37eb5bdbd None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:41.181909 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e29a46-c792-454e-8314-05c37eb5bdbd None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:41.182181 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e29a46-c792-454e-8314-05c37eb5bdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:41.201873 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-c0e29a46-c792-454e-8314-05c37eb5bdbd None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:41.203280 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c0e29a46-c792-454e-8314-05c37eb5bdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:41.285484 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 312/614] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:43:41.285967 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804866e-f60b-4dcf-9ae3-8463f2994147 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:41.286486 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e29a46-c792-454e-8314-05c37eb5bdbd None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:41.304354 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:41.323533 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd62c76-e1ad-4435-89dd-807a24726c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:41.324289 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd62c76-e1ad-4435-89dd-807a24726c59 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:41.324699 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd62c76-e1ad-4435-89dd-807a24726c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:41.325037 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd62c76-e1ad-4435-89dd-807a24726c59 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:41.332705 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd62c76-e1ad-4435-89dd-807a24726c59 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:41.334411 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd62c76-e1ad-4435-89dd-807a24726c59 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:41.355446 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-abd62c76-e1ad-4435-89dd-807a24726c59 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 30 00:43:41.355446 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:41.355446 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:41.355446 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:41.355446 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:41.355446 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:41.355446 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:41.355446 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:41.355446 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:41.355446 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:41.355446 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:41.355446 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:41.355446 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:43:41.355446 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:43:41.355446 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:43:41.355446 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:43:41.357601 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:41.357601 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:41.357601 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:43:41.357601 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:41.357601 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:43:41.357601 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:41.357601 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:41.357601 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:41.357601 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:41.357601 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:41.357601 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:41.357601 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:41.357601 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:41.357601 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:41.357601 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:41.357601 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:41.357601 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:41.357601 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:41.359817 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:41.359817 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:41.359817 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:43:41.359817 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:43:41.359817 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:43:41.359817 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:43:41.359817 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:43:41.359817 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:43:41.359817 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 30 00:43:41.359817 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:41.362748 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 303/615] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Oct 30 00:43:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:41.370123 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd62c76-e1ad-4435-89dd-807a24726c59 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:41.409757 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:41.412656 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e29a46-c792-454e-8314-05c37eb5bdbd None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:41.449027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1f7ee-033a-4b72-9999-e0c7874edc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:41.449676 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1f7ee-033a-4b72-9999-e0c7874edc38 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:41.449972 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1f7ee-033a-4b72-9999-e0c7874edc38 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:41.450248 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1f7ee-033a-4b72-9999-e0c7874edc38 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:41.450943 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1f7ee-033a-4b72-9999-e0c7874edc38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:41.451248 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1f7ee-033a-4b72-9999-e0c7874edc38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:41.452834 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1f7ee-033a-4b72-9999-e0c7874edc38 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:41.466035 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 313/616] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Oct 30 00:43:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:41.472338 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1f7ee-033a-4b72-9999-e0c7874edc38 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:41.588820 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd62c76-e1ad-4435-89dd-807a24726c59 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:41.642034 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac15d9-bcd9-43a0-8659-f5a10901a34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:41.642647 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac15d9-bcd9-43a0-8659-f5a10901a34b None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:41.642925 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac15d9-bcd9-43a0-8659-f5a10901a34b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:41.643196 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac15d9-bcd9-43a0-8659-f5a10901a34b None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:41.643721 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1f7ee-033a-4b72-9999-e0c7874edc38 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:41.643927 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac15d9-bcd9-43a0-8659-f5a10901a34b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:41.644230 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac15d9-bcd9-43a0-8659-f5a10901a34b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:41.646811 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac15d9-bcd9-43a0-8659-f5a10901a34b None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:41.672332 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 304/617] 10.222.0.40 () {56 vars in 1135 bytes} [Sun Oct 30 00:43:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:41.673395 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77f1b9-c066-4f8c-81f1-cc92df71b0c8 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:41.673528 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77f1b9-c066-4f8c-81f1-cc92df71b0c8 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:41.673785 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77f1b9-c066-4f8c-81f1-cc92df71b0c8 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:41.675094 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 305/618] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:41.675641 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77f1b9-c066-4f8c-81f1-cc92df71b0c8 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:41.684542 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45513c-2c21-4e49-8b01-3ca017887862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:41.685135 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45513c-2c21-4e49-8b01-3ca017887862 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:41.685440 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45513c-2c21-4e49-8b01-3ca017887862 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:41.685705 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45513c-2c21-4e49-8b01-3ca017887862 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:41.686702 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45513c-2c21-4e49-8b01-3ca017887862 None admin] RBAC: Adding query filter params (role.id=53b761158f744776b470f11e00bdaa81, scope.project.id=8969ed754fe24784a2025cbdbf6f1a8b, user.id=c625c9434922494aa868f1a5511963f3) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:41.687011 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45513c-2c21-4e49-8b01-3ca017887862 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:41.688417 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45513c-2c21-4e49-8b01-3ca017887862 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:41.694315 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 314/619] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Oct 30 00:43:41 2022] GET /identity/v3/role_assignments?user.id=c625c9434922494aa868f1a5511963f3&scope.project.id=8969ed754fe24784a2025cbdbf6f1a8b&role.id=53b761158f744776b470f11e00bdaa81 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:41.695080 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45513c-2c21-4e49-8b01-3ca017887862 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:41.739306 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:41.742066 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:41.830537 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45513c-2c21-4e49-8b01-3ca017887862 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:41.853241 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77f1b9-c066-4f8c-81f1-cc92df71b0c8 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:41.870336 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948631c1-a487-4e78-9277-f137a620d738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:41.870999 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948631c1-a487-4e78-9277-f137a620d738 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:41.871331 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948631c1-a487-4e78-9277-f137a620d738 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:41.871599 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948631c1-a487-4e78-9277-f137a620d738 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:41.897277 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef980f6-6a89-4696-ad53-0b5299c4d527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:41.898521 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef980f6-6a89-4696-ad53-0b5299c4d527 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:41.898521 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef980f6-6a89-4696-ad53-0b5299c4d527 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:41.898521 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef980f6-6a89-4696-ad53-0b5299c4d527 None admin] PATH_INFO: `/v3/services/network` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:41.899541 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef980f6-6a89-4696-ad53-0b5299c4d527 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:41.900604 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef980f6-6a89-4696-ad53-0b5299c4d527 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:41.910697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-cef980f6-6a89-4696-ad53-0b5299c4d527 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 30 00:43:41.910697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:41.910697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:43:41.910697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:43:41.910697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:43:41.910697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:43:41.910697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:43:41.910697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:41.910697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 30 00:43:41.910697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:41.910697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:43:41.910697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:41.910697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:41.910697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:41.910697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:41.910697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:41.910697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:41.911676 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:41.911676 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:41.911676 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:41.911676 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:41.911676 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:41.911676 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:41.911676 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:43:41.911676 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:43:41.911676 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:43:41.911676 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:43:41.911676 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:41.911676 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:41.911676 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:41.911676 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:41.911676 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:41.911676 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:41.912507 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:41.912507 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:41.912507 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:41.912507 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:41.912507 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:41.912507 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:41.912507 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:41.912507 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:41.912507 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:41.912507 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:41.912507 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:43:41.912507 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:41.912507 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 30 00:43:41.912507 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:41.912507 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 306/620] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:43:41 2022] GET /identity/v3/services/network => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:41.913408 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c5ebb-57a2-40a7-8b68-9ec14d4226c9 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:41.913408 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c5ebb-57a2-40a7-8b68-9ec14d4226c9 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:41.913529 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c5ebb-57a2-40a7-8b68-9ec14d4226c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:41.932662 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-c38c5ebb-57a2-40a7-8b68-9ec14d4226c9 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:41.934469 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c38c5ebb-57a2-40a7-8b68-9ec14d4226c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:41.950484 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948631c1-a487-4e78-9277-f137a620d738 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:41.951936 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948631c1-a487-4e78-9277-f137a620d738 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:41.978542 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:42.009834 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 307/621] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:43:42.011614 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fcaaa-e359-49be-98e7-338ea22a8eec None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:42.011893 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fcaaa-e359-49be-98e7-338ea22a8eec None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:42.012160 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fcaaa-e359-49be-98e7-338ea22a8eec None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:42.013527 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 308/622] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:42.014140 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fcaaa-e359-49be-98e7-338ea22a8eec None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:42.061689 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:42.075078 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 315/623] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Oct 30 00:43:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 30 00:43:42.076421 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fb731-9e53-4b6f-a0cc-3a4836d8f08f None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:42.077295 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fb731-9e53-4b6f-a0cc-3a4836d8f08f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:42.077840 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fb731-9e53-4b6f-a0cc-3a4836d8f08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:42.098452 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-9d2fb731-9e53-4b6f-a0cc-3a4836d8f08f None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:42.100000 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9d2fb731-9e53-4b6f-a0cc-3a4836d8f08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:42.155494 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fcaaa-e359-49be-98e7-338ea22a8eec None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:42.170578 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 316/624] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:43:42.171693 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fb731-9e53-4b6f-a0cc-3a4836d8f08f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:42.212727 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80dfa1-83c3-4e39-9027-fda8541ccc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:42.213324 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80dfa1-83c3-4e39-9027-fda8541ccc20 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:42.213599 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80dfa1-83c3-4e39-9027-fda8541ccc20 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:42.213866 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80dfa1-83c3-4e39-9027-fda8541ccc20 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:42.215182 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed80dfa1-83c3-4e39-9027-fda8541ccc20 None admin] RBAC: Adding query filter params (name=network) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:42.215479 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed80dfa1-83c3-4e39-9027-fda8541ccc20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:42.216897 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed80dfa1-83c3-4e39-9027-fda8541ccc20 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:42.226935 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 309/625] 10.222.0.40 () {56 vars in 1112 bytes} [Sun Oct 30 00:43:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:42.231012 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80dfa1-83c3-4e39-9027-fda8541ccc20 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:42.273013 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:42.334741 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fb731-9e53-4b6f-a0cc-3a4836d8f08f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:42.357610 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:42.367125 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80dfa1-83c3-4e39-9027-fda8541ccc20 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:42.379219 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b17198-e7f2-4f68-9a32-c12b91c2fcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:42.380166 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b17198-e7f2-4f68-9a32-c12b91c2fcb9 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:42.380444 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b17198-e7f2-4f68-9a32-c12b91c2fcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:42.380713 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b17198-e7f2-4f68-9a32-c12b91c2fcb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:42.393851 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b17198-e7f2-4f68-9a32-c12b91c2fcb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:42.395598 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b17198-e7f2-4f68-9a32-c12b91c2fcb9 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:42.405350 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e83eec-8e89-4183-bd6c-56e6e0d7c928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:42.406222 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e83eec-8e89-4183-bd6c-56e6e0d7c928 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:42.406726 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e83eec-8e89-4183-bd6c-56e6e0d7c928 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:42.407226 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e83eec-8e89-4183-bd6c-56e6e0d7c928 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:42.408054 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e83eec-8e89-4183-bd6c-56e6e0d7c928 None admin] RBAC: Adding query filter params (type=network) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:42.408555 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e83eec-8e89-4183-bd6c-56e6e0d7c928 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:42.410131 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e83eec-8e89-4183-bd6c-56e6e0d7c928 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:42.413849 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-e3b17198-e7f2-4f68-9a32-c12b91c2fcb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:42.413849 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:42.413849 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:42.413849 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:42.413849 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:42.413849 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:42.413849 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:42.413849 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:42.413849 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:42.413849 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:42.413849 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:42.413849 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:42.413849 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:42.413849 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:42.413849 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:42.413849 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:42.415111 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:42.415111 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:42.415111 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:42.415111 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:42.415111 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:42.415111 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:42.415111 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:42.415111 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:42.415111 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:42.415111 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:42.415111 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:42.415111 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:42.415111 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:42.415111 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:42.415111 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:42.415111 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:42.415111 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:42.416021 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:42.416021 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:42.416021 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:42.416021 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 317/626] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:42.416676 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b17198-e7f2-4f68-9a32-c12b91c2fcb9 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:42.423992 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 310/627] 10.222.0.40 () {56 vars in 1112 bytes} [Sun Oct 30 00:43:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:42.425362 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e83eec-8e89-4183-bd6c-56e6e0d7c928 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:42.536883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b17198-e7f2-4f68-9a32-c12b91c2fcb9 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:42.540138 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e83eec-8e89-4183-bd6c-56e6e0d7c928 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:42.544460 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:42.572342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1218d7-f69d-498f-9540-81910d8ff501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:42.572960 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1218d7-f69d-498f-9540-81910d8ff501 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:42.573269 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1218d7-f69d-498f-9540-81910d8ff501 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:42.573516 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1218d7-f69d-498f-9540-81910d8ff501 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:42.574606 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1218d7-f69d-498f-9540-81910d8ff501 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:42.576051 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1218d7-f69d-498f-9540-81910d8ff501 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:42.580522 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575eabe3-ad30-4e2b-b776-6a54ea57290d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:42.581122 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575eabe3-ad30-4e2b-b776-6a54ea57290d None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:42.581447 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575eabe3-ad30-4e2b-b776-6a54ea57290d None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:42.581719 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575eabe3-ad30-4e2b-b776-6a54ea57290d None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:42.582362 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575eabe3-ad30-4e2b-b776-6a54ea57290d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:42.582661 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575eabe3-ad30-4e2b-b776-6a54ea57290d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:42.583996 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575eabe3-ad30-4e2b-b776-6a54ea57290d None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:42.584846 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-4c1218d7-f69d-498f-9540-81910d8ff501 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 30 00:43:42.584846 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:42.584846 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:43:42.584846 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:43:42.584846 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:43:42.584846 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:43:42.584846 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:43:42.584846 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:42.584846 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 30 00:43:42.584846 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:42.584846 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:43:42.584846 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:42.584846 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:42.584846 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:42.584846 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:42.584846 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:42.584846 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:42.585937 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:42.585937 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:42.585937 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:42.585937 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:42.585937 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:42.585937 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:42.585937 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:43:42.585937 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:43:42.585937 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:43:42.585937 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:43:42.585937 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:42.585937 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:42.585937 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:42.585937 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:42.585937 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:42.585937 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:42.586858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:42.586858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:42.586858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:42.586858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:42.586858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:42.586858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:42.586858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:42.586858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:42.586858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:42.586858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:42.586858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:43:42.586858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:42.586858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 30 00:43:42.586858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:42.586858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 318/628] 10.222.0.40 () {56 vars in 1129 bytes} [Sun Oct 30 00:43:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:42.587779 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1218d7-f69d-498f-9540-81910d8ff501 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:42.601377 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 311/629] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:42.602055 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575eabe3-ad30-4e2b-b776-6a54ea57290d None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:42.620819 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:42.702565 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1218d7-f69d-498f-9540-81910d8ff501 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:42.718785 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575eabe3-ad30-4e2b-b776-6a54ea57290d None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:42.734488 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4748ab-2db4-4445-8c29-9beda8ac440d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:42.735090 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4748ab-2db4-4445-8c29-9beda8ac440d None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:42.735369 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4748ab-2db4-4445-8c29-9beda8ac440d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:42.735641 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4748ab-2db4-4445-8c29-9beda8ac440d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:42.736297 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4748ab-2db4-4445-8c29-9beda8ac440d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:42.737687 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4748ab-2db4-4445-8c29-9beda8ac440d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:42.755257 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74dde6-fe76-482e-90c1-aec2b5f08484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:42.755851 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74dde6-fe76-482e-90c1-aec2b5f08484 None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:42.756117 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74dde6-fe76-482e-90c1-aec2b5f08484 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:42.756384 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74dde6-fe76-482e-90c1-aec2b5f08484 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:42.757072 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74dde6-fe76-482e-90c1-aec2b5f08484 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:42.758453 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74dde6-fe76-482e-90c1-aec2b5f08484 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:42.759131 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 319/630] 10.222.0.40 () {60 vars in 1144 bytes} [Sun Oct 30 00:43:42 2022] POST /identity/v3/endpoints => generated 337 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:43:42.762176 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4748ab-2db4-4445-8c29-9beda8ac440d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:42.788251 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 312/631] 10.222.0.40 () {60 vars in 1141 bytes} [Sun Oct 30 00:43:42 2022] POST /identity/v3/services => generated 269 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:43:42.789758 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74dde6-fe76-482e-90c1-aec2b5f08484 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:42.800716 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:42.891885 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4748ab-2db4-4445-8c29-9beda8ac440d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:42.948490 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f5556-7c9e-468a-a88a-28457f48a6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:42.949147 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f5556-7c9e-468a-a88a-28457f48a6d3 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:42.949459 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f5556-7c9e-468a-a88a-28457f48a6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:42.949728 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f5556-7c9e-468a-a88a-28457f48a6d3 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:42.950363 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f5556-7c9e-468a-a88a-28457f48a6d3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:42.950652 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f5556-7c9e-468a-a88a-28457f48a6d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:42.954465 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:42.955211 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f5556-7c9e-468a-a88a-28457f48a6d3 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:42.965230 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 320/632] 10.222.0.40 () {56 vars in 1124 bytes} [Sun Oct 30 00:43:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:42.971073 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f5556-7c9e-468a-a88a-28457f48a6d3 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:42.994647 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74dde6-fe76-482e-90c1-aec2b5f08484 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:43.052739 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa43ae6-e666-4833-87cc-7cc6c2ae9f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:43.053331 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa43ae6-e666-4833-87cc-7cc6c2ae9f9a None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:43.053609 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa43ae6-e666-4833-87cc-7cc6c2ae9f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:43.053881 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa43ae6-e666-4833-87cc-7cc6c2ae9f9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:43.061958 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa43ae6-e666-4833-87cc-7cc6c2ae9f9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:43.063669 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa43ae6-e666-4833-87cc-7cc6c2ae9f9a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:43.082379 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-2fa43ae6-e666-4833-87cc-7cc6c2ae9f9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:43.082379 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:43.082379 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:43.082379 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:43.082379 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:43.082379 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:43.082379 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:43.082379 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:43.082379 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:43.082379 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:43.082379 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:43.082379 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:43.082379 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:43:43.082379 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:43:43.082379 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:43:43.083376 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:43:43.083376 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:43.083376 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:43.083376 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:43.083376 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:43.083376 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:43.083376 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:43.083376 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:43.083376 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:43.083376 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:43.083376 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:43.083376 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:43.083376 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:43.083376 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:43.083376 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:43.083376 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:43.083376 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:43.084684 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:43:43.084684 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:43:43.084684 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:43:43.084684 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:43:43.084684 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:43:43.084684 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:43:43.084684 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:43.084684 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:43.084684 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 313/633] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:43:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:43.089886 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa43ae6-e666-4833-87cc-7cc6c2ae9f9a None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:43.090626 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:43.117369 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f5556-7c9e-468a-a88a-28457f48a6d3 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:43.163482 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba18aa-ce1c-4f37-82e5-bdc55f53f77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:43.164090 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba18aa-ce1c-4f37-82e5-bdc55f53f77c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:43.164371 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba18aa-ce1c-4f37-82e5-bdc55f53f77c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:43.164642 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba18aa-ce1c-4f37-82e5-bdc55f53f77c None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:43.165306 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba18aa-ce1c-4f37-82e5-bdc55f53f77c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:43.165609 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba18aa-ce1c-4f37-82e5-bdc55f53f77c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:43.166973 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba18aa-ce1c-4f37-82e5-bdc55f53f77c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:43.173217 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 321/634] 10.222.0.40 () {56 vars in 1124 bytes} [Sun Oct 30 00:43:42 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:43:43.178315 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba18aa-ce1c-4f37-82e5-bdc55f53f77c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:43.213401 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa43ae6-e666-4833-87cc-7cc6c2ae9f9a None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:43.249529 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a2b4b-fabb-4a9e-b5e2-52c09bef4a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:43.250185 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a2b4b-fabb-4a9e-b5e2-52c09bef4a16 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:43.250461 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a2b4b-fabb-4a9e-b5e2-52c09bef4a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:43.250788 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a2b4b-fabb-4a9e-b5e2-52c09bef4a16 None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:43.251471 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a2b4b-fabb-4a9e-b5e2-52c09bef4a16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:43.251771 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a2b4b-fabb-4a9e-b5e2-52c09bef4a16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:43.253229 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a2b4b-fabb-4a9e-b5e2-52c09bef4a16 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:43.267191 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 314/635] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Oct 30 00:43:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:43:43.267474 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:43.275188 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a2b4b-fabb-4a9e-b5e2-52c09bef4a16 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:43.305754 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba18aa-ce1c-4f37-82e5-bdc55f53f77c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:43.339475 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d53f84-d246-4ee5-b7df-27270d2f4bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:43.340077 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d53f84-d246-4ee5-b7df-27270d2f4bb0 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:43.340412 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d53f84-d246-4ee5-b7df-27270d2f4bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:43.340690 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d53f84-d246-4ee5-b7df-27270d2f4bb0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:43.341389 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d53f84-d246-4ee5-b7df-27270d2f4bb0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:43.342767 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d53f84-d246-4ee5-b7df-27270d2f4bb0 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:43.364054 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 322/636] 10.222.0.40 () {60 vars in 1144 bytes} [Sun Oct 30 00:43:43 2022] POST /identity/v3/endpoints => generated 346 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:43:43.391629 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a2b4b-fabb-4a9e-b5e2-52c09bef4a16 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:43.439225 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04b3b1-3c63-449c-8142-9e447ca67f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:43.439842 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04b3b1-3c63-449c-8142-9e447ca67f74 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:43.440169 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04b3b1-3c63-449c-8142-9e447ca67f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:43.440436 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04b3b1-3c63-449c-8142-9e447ca67f74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:43.441244 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04b3b1-3c63-449c-8142-9e447ca67f74 None admin] RBAC: Adding query filter params (role.id=17d0330d6df84d3091d7ef234dfc4e6b, scope.project.id=8969ed754fe24784a2025cbdbf6f1a8b, user.id=b996b01e045b4034be43a907536079c0) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:43.441549 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04b3b1-3c63-449c-8142-9e447ca67f74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:43.443000 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04b3b1-3c63-449c-8142-9e447ca67f74 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:43.450870 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 315/637] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Oct 30 00:43:43 2022] GET /identity/v3/role_assignments?user.id=b996b01e045b4034be43a907536079c0&scope.project.id=8969ed754fe24784a2025cbdbf6f1a8b&role.id=17d0330d6df84d3091d7ef234dfc4e6b => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:43.996238 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a551e8-a119-4d70-b24a-5ffee619b558 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:43.996743 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a551e8-a119-4d70-b24a-5ffee619b558 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:43.996743 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a551e8-a119-4d70-b24a-5ffee619b558 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:43.998566 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 323/638] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:44.005944 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6fe9d-ea90-4846-b191-c230e31795af None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:44.006382 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6fe9d-ea90-4846-b191-c230e31795af None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:44.006475 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6fe9d-ea90-4846-b191-c230e31795af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:44.024910 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-c1d6fe9d-ea90-4846-b191-c230e31795af None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:44.026132 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c1d6fe9d-ea90-4846-b191-c230e31795af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:44.078061 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:44.094690 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 316/639] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:44 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:43:44.368026 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a551e8-a119-4d70-b24a-5ffee619b558 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:44.371086 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:44.480990 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a551e8-a119-4d70-b24a-5ffee619b558 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:44.514399 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f1edb-f4d9-4a0e-939a-cde43cebda03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:44.515016 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f1edb-f4d9-4a0e-939a-cde43cebda03 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:44.515343 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f1edb-f4d9-4a0e-939a-cde43cebda03 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:44.515623 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f1edb-f4d9-4a0e-939a-cde43cebda03 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:44.526599 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f1edb-f4d9-4a0e-939a-cde43cebda03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:43:44.531769 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-502f1edb-f4d9-4a0e-939a-cde43cebda03 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 30 00:43:44.531769 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:44.531769 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:44.531769 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:44.531769 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:44.531769 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:44.531769 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:44.531769 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:44.531769 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:44.531769 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:44.531769 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:44.531769 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:44.531769 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:43:44.531769 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:43:44.531769 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:43:44.531769 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:43:44.532701 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:43:44.532701 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:43:44.532701 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:43:44.532701 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:43:44.532701 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:44.532701 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:44.532701 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:44.532701 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:44.532701 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:44.532701 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:44.532701 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:44.532701 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:44.532701 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:44.532701 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:44.532701 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:44.532701 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:44.533735 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:44.533735 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:44.533735 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:44.533735 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:44.533735 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:43:44.533735 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:43:44.533735 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:43:44.533735 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:43:44.533735 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:43:44.533735 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:43:44.533735 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 30 00:43:44.533735 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:44.533735 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 324/640] 10.222.0.40 () {56 vars in 1120 bytes} [Sun Oct 30 00:43:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:44.538833 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6fe9d-ea90-4846-b191-c230e31795af None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:44.640168 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6fe9d-ea90-4846-b191-c230e31795af None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:44.678686 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92036221-3b73-4b90-a626-96cbe727811f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:44.679299 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92036221-3b73-4b90-a626-96cbe727811f None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:44.679576 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92036221-3b73-4b90-a626-96cbe727811f None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:44.679846 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92036221-3b73-4b90-a626-96cbe727811f None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:44.680506 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92036221-3b73-4b90-a626-96cbe727811f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:44.680804 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92036221-3b73-4b90-a626-96cbe727811f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:44.682207 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92036221-3b73-4b90-a626-96cbe727811f None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:44.691055 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 317/641] 10.222.0.40 () {56 vars in 1115 bytes} [Sun Oct 30 00:43:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:44.696592 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f1edb-f4d9-4a0e-939a-cde43cebda03 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:44.760375 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:44.801867 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f1edb-f4d9-4a0e-939a-cde43cebda03 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:44.840902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca264a9-8fe3-44fb-bf75-604797b7f967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:44.841552 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca264a9-8fe3-44fb-bf75-604797b7f967 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:44.841828 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca264a9-8fe3-44fb-bf75-604797b7f967 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:44.842098 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca264a9-8fe3-44fb-bf75-604797b7f967 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:44.852834 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca264a9-8fe3-44fb-bf75-604797b7f967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:44.854302 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca264a9-8fe3-44fb-bf75-604797b7f967 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:44.868342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-9ca264a9-8fe3-44fb-bf75-604797b7f967 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:44.868342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:44.868342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:44.868342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:44.868342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:44.868342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:44.868342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:44.868342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:44.868342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:44.868342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:44.868342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:44.868342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:44.868342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:44.868342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:44.868342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:44.868342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:44.869329 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:44.869329 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:44.869329 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:44.869329 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:44.869329 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:44.869329 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:44.869329 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:44.869329 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:44.869329 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:44.869329 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:44.869329 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:44.869329 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:44.869329 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:44.869329 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:44.869329 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:44.869329 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:44.869329 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:44.870976 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:44.870976 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:44.870976 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:44.870976 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 325/642] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:44.875254 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92036221-3b73-4b90-a626-96cbe727811f None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:44.930257 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:44.981763 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92036221-3b73-4b90-a626-96cbe727811f None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:45.015710 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09afe0-5fcf-481d-a035-a4d6c5e2f192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:45.016323 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09afe0-5fcf-481d-a035-a4d6c5e2f192 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:45.016566 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09afe0-5fcf-481d-a035-a4d6c5e2f192 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:45.016840 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09afe0-5fcf-481d-a035-a4d6c5e2f192 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:45.017737 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09afe0-5fcf-481d-a035-a4d6c5e2f192 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:45.018189 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09afe0-5fcf-481d-a035-a4d6c5e2f192 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:45.019683 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09afe0-5fcf-481d-a035-a4d6c5e2f192 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:45.032974 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 318/643] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:45.038226 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca264a9-8fe3-44fb-bf75-604797b7f967 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:45.144057 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca264a9-8fe3-44fb-bf75-604797b7f967 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:45.160457 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:45.182744 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1df323-a535-4572-ab51-2d21e9964ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:45.184231 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1df323-a535-4572-ab51-2d21e9964ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:45.184706 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1df323-a535-4572-ab51-2d21e9964ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:45.185273 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1df323-a535-4572-ab51-2d21e9964ee9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:45.193499 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1df323-a535-4572-ab51-2d21e9964ee9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:45.195205 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1df323-a535-4572-ab51-2d21e9964ee9 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:45.207418 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-7a1df323-a535-4572-ab51-2d21e9964ee9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 30 00:43:45.207418 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:45.207418 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:45.207418 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:45.207418 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:45.207418 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:45.207418 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:45.207418 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:45.207418 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:45.207418 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:45.207418 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:45.207418 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:45.207418 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:43:45.207418 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:43:45.207418 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:43:45.207418 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:43:45.208378 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:45.208378 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:45.208378 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:43:45.208378 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:45.208378 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:43:45.208378 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:45.208378 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:45.208378 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:45.208378 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:45.208378 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:45.208378 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:45.208378 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:45.208378 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:45.208378 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:45.208378 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:45.208378 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:45.208378 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:45.208378 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:45.209358 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:45.209358 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:45.209358 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:43:45.209358 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:43:45.209358 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:43:45.209358 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:43:45.209358 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:43:45.209358 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:43:45.209358 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 30 00:43:45.209358 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:45.211869 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 326/644] 10.222.0.40 () {56 vars in 1117 bytes} [Sun Oct 30 00:43:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:45.217376 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09afe0-5fcf-481d-a035-a4d6c5e2f192 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:45.252227 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933509d2-bac8-4714-b477-95645fe44eee None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:45.252559 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933509d2-bac8-4714-b477-95645fe44eee None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:45.252771 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933509d2-bac8-4714-b477-95645fe44eee None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:45.258016 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 327/645] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:43:45.259285 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b876b1a-0b58-4a26-b147-1ac8c861de74 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:45.259632 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b876b1a-0b58-4a26-b147-1ac8c861de74 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:45.259975 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b876b1a-0b58-4a26-b147-1ac8c861de74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:45.281848 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-5b876b1a-0b58-4a26-b147-1ac8c861de74 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:45.283136 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-5b876b1a-0b58-4a26-b147-1ac8c861de74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:45.328152 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09afe0-5fcf-481d-a035-a4d6c5e2f192 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:45.338253 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:45.366749 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3fd2b-3e29-49ae-9e26-faa3cf7915ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:45.367445 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3fd2b-3e29-49ae-9e26-faa3cf7915ab None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:45.367718 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3fd2b-3e29-49ae-9e26-faa3cf7915ab None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:45.367979 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3fd2b-3e29-49ae-9e26-faa3cf7915ab None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:45.368497 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 328/646] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:45 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:43:45.369586 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf3fd2b-3e29-49ae-9e26-faa3cf7915ab None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:45.369891 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf3fd2b-3e29-49ae-9e26-faa3cf7915ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:45.371885 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf3fd2b-3e29-49ae-9e26-faa3cf7915ab None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:45.393990 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 319/647] 10.222.0.40 () {56 vars in 1149 bytes} [Sun Oct 30 00:43:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:45.400054 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b876b1a-0b58-4a26-b147-1ac8c861de74 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:45.506093 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b876b1a-0b58-4a26-b147-1ac8c861de74 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:45.508417 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:45.541777 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4577f9d-44c6-483f-9871-6c3978fb94cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:45.542400 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4577f9d-44c6-483f-9871-6c3978fb94cd None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:45.543218 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4577f9d-44c6-483f-9871-6c3978fb94cd None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:45.543484 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4577f9d-44c6-483f-9871-6c3978fb94cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:45.553941 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4577f9d-44c6-483f-9871-6c3978fb94cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:45.555372 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4577f9d-44c6-483f-9871-6c3978fb94cd None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:45.572058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-f4577f9d-44c6-483f-9871-6c3978fb94cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:45.572058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:45.572058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:45.572058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:45.572058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:45.572058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:45.572058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:45.572058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:45.572058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:45.572058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:45.572058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:45.572058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:45.572058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:45.572058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:45.572058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:45.572058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:45.573081 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:45.573081 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:45.573081 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:45.573081 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:45.573081 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:45.573081 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:45.573081 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:45.573081 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:45.573081 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:45.573081 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:45.573081 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:45.573081 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:45.573081 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:45.573081 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:45.573081 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:45.573081 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:45.573081 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:45.574065 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:45.574065 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:45.574065 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:45.574065 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 329/648] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:45.580534 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3fd2b-3e29-49ae-9e26-faa3cf7915ab None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:45.658722 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4577f9d-44c6-483f-9871-6c3978fb94cd None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:45.700783 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3fd2b-3e29-49ae-9e26-faa3cf7915ab None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:45.742815 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db962d1f-8bf9-4f22-98f3-615e0d873007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:45.743727 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db962d1f-8bf9-4f22-98f3-615e0d873007 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:45.744002 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db962d1f-8bf9-4f22-98f3-615e0d873007 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:45.744269 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db962d1f-8bf9-4f22-98f3-615e0d873007 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:45.744900 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db962d1f-8bf9-4f22-98f3-615e0d873007 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:45.745217 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db962d1f-8bf9-4f22-98f3-615e0d873007 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:45.747105 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db962d1f-8bf9-4f22-98f3-615e0d873007 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:45.758451 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 320/649] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:45.759678 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85db92-a826-4db4-a05a-12056948f845 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:45.759968 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85db92-a826-4db4-a05a-12056948f845 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:45.760241 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85db92-a826-4db4-a05a-12056948f845 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:45.762017 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 321/650] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:45.763136 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b7ce9-a2b0-4f62-949c-7a680ff09762 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:45.763692 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b7ce9-a2b0-4f62-949c-7a680ff09762 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:45.763969 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b7ce9-a2b0-4f62-949c-7a680ff09762 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:45.765296 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 322/651] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:45.769845 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b7ce9-a2b0-4f62-949c-7a680ff09762 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:45.779560 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4577f9d-44c6-483f-9871-6c3978fb94cd None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:45.796714 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:45.811853 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a0d10-32f9-4469-9888-252a776ae437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:45.812464 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a0d10-32f9-4469-9888-252a776ae437 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:45.812740 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a0d10-32f9-4469-9888-252a776ae437 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:45.813006 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a0d10-32f9-4469-9888-252a776ae437 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:45.813669 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a0d10-32f9-4469-9888-252a776ae437 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:45.815011 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a0d10-32f9-4469-9888-252a776ae437 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:45.823402 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-270a0d10-32f9-4469-9888-252a776ae437 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 30 00:43:45.823402 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:45.823402 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:43:45.823402 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:43:45.823402 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:43:45.823402 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:43:45.823402 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:43:45.823402 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:45.823402 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 30 00:43:45.823402 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:45.823402 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:43:45.823402 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:45.823402 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:45.823402 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:45.823402 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:45.823402 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:45.824398 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:45.824398 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:45.824398 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:45.824398 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:45.824398 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:45.824398 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:45.824398 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:45.824398 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:43:45.824398 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:43:45.824398 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:43:45.824398 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:43:45.824398 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:45.824398 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:45.824398 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:45.824398 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:45.824398 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:45.824398 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:45.825345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:45.825345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:45.825345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:45.825345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:45.825345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:45.825345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:45.825345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:45.825345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:45.825345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:45.825345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:45.825345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:43:45.825345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:45.825345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 30 00:43:45.825345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:45.829529 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 330/652] 10.222.0.40 () {56 vars in 1132 bytes} [Sun Oct 30 00:43:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:43:45.830649 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a8f18-a5b2-468d-8095-e05d7bbe2f00 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:45.830932 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a8f18-a5b2-468d-8095-e05d7bbe2f00 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:45.831202 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a8f18-a5b2-468d-8095-e05d7bbe2f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:45.849973 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-738a8f18-a5b2-468d-8095-e05d7bbe2f00 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:45.851134 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-738a8f18-a5b2-468d-8095-e05d7bbe2f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:45.865533 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:45.870877 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b7ce9-a2b0-4f62-949c-7a680ff09762 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:45.903802 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594cf65-8af8-4d2c-bf4b-398e5e2f50a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:45.904403 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594cf65-8af8-4d2c-bf4b-398e5e2f50a8 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:45.904681 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594cf65-8af8-4d2c-bf4b-398e5e2f50a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:45.904944 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594cf65-8af8-4d2c-bf4b-398e5e2f50a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:45.911243 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594cf65-8af8-4d2c-bf4b-398e5e2f50a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:45.912657 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594cf65-8af8-4d2c-bf4b-398e5e2f50a8 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:45.917581 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 331/653] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:45 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:43:45.919268 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24082a3-3b3a-49b7-a21d-a0e820e3676d None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:45.919549 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24082a3-3b3a-49b7-a21d-a0e820e3676d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:45.919814 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24082a3-3b3a-49b7-a21d-a0e820e3676d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:45.924205 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-1594cf65-8af8-4d2c-bf4b-398e5e2f50a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:45.924205 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:45.924205 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:45.924205 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:45.924205 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:45.924205 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:45.924205 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:45.924205 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:45.924205 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:45.924205 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:45.924205 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:45.924205 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:45.924205 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:43:45.924205 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:43:45.924205 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:43:45.925084 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:43:45.925084 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:45.925084 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:45.925084 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:45.925084 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:45.925084 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:45.925084 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:45.925084 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:45.925084 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:45.925084 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:45.925084 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:45.925084 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:45.925084 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:45.925084 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:45.925084 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:45.925084 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:45.925084 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:45.931065 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:43:45.931065 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:43:45.931065 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:43:45.931065 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:43:45.931065 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:43:45.931065 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:43:45.931065 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:45.931065 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:45.931065 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 323/654] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:43:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:45.931065 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594cf65-8af8-4d2c-bf4b-398e5e2f50a8 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:45.948042 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a24082a3-3b3a-49b7-a21d-a0e820e3676d None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:45.949264 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a24082a3-3b3a-49b7-a21d-a0e820e3676d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:46.019435 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:46.021523 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 332/655] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:45 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:43:46.022273 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24082a3-3b3a-49b7-a21d-a0e820e3676d None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:46.041448 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594cf65-8af8-4d2c-bf4b-398e5e2f50a8 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:46.082644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462f006-6d42-4b58-8f73-cb1c9dfdb177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:46.083741 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462f006-6d42-4b58-8f73-cb1c9dfdb177 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:46.084163 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462f006-6d42-4b58-8f73-cb1c9dfdb177 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:46.084595 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462f006-6d42-4b58-8f73-cb1c9dfdb177 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:46.085406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462f006-6d42-4b58-8f73-cb1c9dfdb177 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:46.085868 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462f006-6d42-4b58-8f73-cb1c9dfdb177 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:46.087433 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462f006-6d42-4b58-8f73-cb1c9dfdb177 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:46.094488 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 324/656] 10.222.0.40 () {56 vars in 1126 bytes} [Sun Oct 30 00:43:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:46.100112 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462f006-6d42-4b58-8f73-cb1c9dfdb177 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:46.127739 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:46.150366 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24082a3-3b3a-49b7-a21d-a0e820e3676d None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:46.190551 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686b790-a0da-42f4-ba6d-e3c896340d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:46.191588 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686b790-a0da-42f4-ba6d-e3c896340d5d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:46.192069 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686b790-a0da-42f4-ba6d-e3c896340d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:46.192564 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686b790-a0da-42f4-ba6d-e3c896340d5d None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:46.193664 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686b790-a0da-42f4-ba6d-e3c896340d5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:46.194821 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686b790-a0da-42f4-ba6d-e3c896340d5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:46.196614 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686b790-a0da-42f4-ba6d-e3c896340d5d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:46.209145 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 333/657] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Oct 30 00:43:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:46.214240 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686b790-a0da-42f4-ba6d-e3c896340d5d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:46.230122 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462f006-6d42-4b58-8f73-cb1c9dfdb177 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:46.265986 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba2f8d-d6e0-4267-8f79-8ae903762b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:46.266436 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba2f8d-d6e0-4267-8f79-8ae903762b63 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:46.266755 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba2f8d-d6e0-4267-8f79-8ae903762b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:46.267023 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba2f8d-d6e0-4267-8f79-8ae903762b63 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:46.267640 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba2f8d-d6e0-4267-8f79-8ae903762b63 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:46.267932 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba2f8d-d6e0-4267-8f79-8ae903762b63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:46.269297 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba2f8d-d6e0-4267-8f79-8ae903762b63 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:46.280415 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 325/658] 10.222.0.40 () {56 vars in 1126 bytes} [Sun Oct 30 00:43:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:43:46.280415 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba2f8d-d6e0-4267-8f79-8ae903762b63 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:46.295073 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:46.329703 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686b790-a0da-42f4-ba6d-e3c896340d5d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:46.364507 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f7405-0453-4228-9f4f-aac4433c4605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:46.365124 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f7405-0453-4228-9f4f-aac4433c4605 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:46.365433 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f7405-0453-4228-9f4f-aac4433c4605 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:46.365699 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f7405-0453-4228-9f4f-aac4433c4605 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:46.366265 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f7405-0453-4228-9f4f-aac4433c4605 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:46.367626 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f7405-0453-4228-9f4f-aac4433c4605 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:46.376256 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-e33f7405-0453-4228-9f4f-aac4433c4605 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 30 00:43:46.376256 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:46.376256 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:43:46.376256 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:43:46.376256 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:43:46.376256 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:43:46.376256 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:43:46.376256 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:46.376256 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 30 00:43:46.376256 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:46.376256 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:43:46.376256 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:46.376256 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:46.376256 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:46.376256 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:46.376256 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:46.376256 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:46.377352 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:46.377352 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:46.377352 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:46.377352 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:46.377352 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:46.377352 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:46.377352 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:43:46.377352 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:43:46.377352 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:43:46.377352 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:43:46.377352 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:46.377352 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:46.377352 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:46.377352 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:46.377352 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:46.377352 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:46.378252 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:46.378252 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:46.378252 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:46.378252 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:46.378252 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:46.378252 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:46.378252 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:46.378252 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:46.378252 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:46.378252 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:46.378252 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:43:46.378252 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:46.378252 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 30 00:43:46.378252 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:46.378252 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 334/659] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Oct 30 00:43:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:46.379455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f7405-0453-4228-9f4f-aac4433c4605 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:46.384158 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:46.390883 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba2f8d-d6e0-4267-8f79-8ae903762b63 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:46.427691 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837774e5-3f1c-4be2-8bac-e077460be744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:46.428336 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837774e5-3f1c-4be2-8bac-e077460be744 None admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:46.428608 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837774e5-3f1c-4be2-8bac-e077460be744 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:46.428878 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837774e5-3f1c-4be2-8bac-e077460be744 None admin] PATH_INFO: `/v3/projects/8969ed754fe24784a2025cbdbf6f1a8b/users/c625c9434922494aa868f1a5511963f3/roles/c80cdb94073e47d0845175cf6e618c64` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:46.431057 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837774e5-3f1c-4be2-8bac-e077460be744 None admin] RBAC: Authorizing `identity:create_grant(project_id=8969ed754fe24784a2025cbdbf6f1a8b, user_id=c625c9434922494aa868f1a5511963f3, role_id=c80cdb94073e47d0845175cf6e618c64)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:46.432478 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837774e5-3f1c-4be2-8bac-e077460be744 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:46.447680 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 326/660] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Oct 30 00:43:46 2022] PUT /identity/v3/projects/8969ed754fe24784a2025cbdbf6f1a8b/users/c625c9434922494aa868f1a5511963f3/roles/c80cdb94073e47d0845175cf6e618c64 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:43:46.448488 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837774e5-3f1c-4be2-8bac-e077460be744 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:46.500396 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f7405-0453-4228-9f4f-aac4433c4605 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:46.540774 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba98943-b67f-4418-b2ac-719ab4d14a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:46.541327 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba98943-b67f-4418-b2ac-719ab4d14a2a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:46.541605 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba98943-b67f-4418-b2ac-719ab4d14a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:46.541871 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba98943-b67f-4418-b2ac-719ab4d14a2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:46.542752 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba98943-b67f-4418-b2ac-719ab4d14a2a None admin] RBAC: Adding query filter params (interface=public, service_id=659b595d94d04feba5ac15e727f13ff9, region_id=RegionOne) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:46.543055 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba98943-b67f-4418-b2ac-719ab4d14a2a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:46.544475 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba98943-b67f-4418-b2ac-719ab4d14a2a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:46.548311 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:46.550523 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 335/661] 10.222.0.40 () {56 vars in 1251 bytes} [Sun Oct 30 00:43:46 2022] GET /identity/v3/endpoints?service_id=659b595d94d04feba5ac15e727f13ff9&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:46.551376 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba98943-b67f-4418-b2ac-719ab4d14a2a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:46.588222 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837774e5-3f1c-4be2-8bac-e077460be744 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:46.628230 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537d951-a594-4137-820f-0f1386731e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:46.628873 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537d951-a594-4137-820f-0f1386731e89 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:46.629149 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537d951-a594-4137-820f-0f1386731e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:46.629453 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537d951-a594-4137-820f-0f1386731e89 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:46.630133 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537d951-a594-4137-820f-0f1386731e89 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:46.631479 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:46.632340 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537d951-a594-4137-820f-0f1386731e89 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:46.643242 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-c537d951-a594-4137-820f-0f1386731e89 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:43:46.643242 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:46.643242 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:43:46.643242 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:43:46.643242 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:43:46.643242 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:43:46.643242 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:43:46.643242 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:46.643242 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:43:46.643242 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:46.643242 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:43:46.643242 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:46.643242 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:46.643242 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:46.643242 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:46.643242 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:46.643242 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:46.644334 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:46.644334 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:46.644334 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:46.644334 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:46.644334 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:46.644334 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:46.644334 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:43:46.644334 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:43:46.644334 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:43:46.644334 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:43:46.644334 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:46.644334 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:46.644334 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:46.644334 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:46.644334 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:46.644334 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:46.645168 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:46.645168 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:46.645168 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:46.645168 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:46.645168 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:46.645168 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:46.645168 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:46.645168 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:46.645168 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:46.645168 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:46.645168 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:43:46.645168 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:46.645168 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:43:46.645168 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:46.645168 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 327/662] 10.222.0.40 () {56 vars in 1126 bytes} [Sun Oct 30 00:43:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:46.646519 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537d951-a594-4137-820f-0f1386731e89 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:46.681473 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba98943-b67f-4418-b2ac-719ab4d14a2a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:46.720587 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cb37f-82f5-4013-b3ad-4c4bfd533392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:46.721205 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cb37f-82f5-4013-b3ad-4c4bfd533392 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:46.721650 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cb37f-82f5-4013-b3ad-4c4bfd533392 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:46.721921 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cb37f-82f5-4013-b3ad-4c4bfd533392 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:46.723331 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33cb37f-82f5-4013-b3ad-4c4bfd533392 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:46.723632 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33cb37f-82f5-4013-b3ad-4c4bfd533392 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:46.724994 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33cb37f-82f5-4013-b3ad-4c4bfd533392 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:46.735606 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 336/663] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Oct 30 00:43:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:46.735606 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cb37f-82f5-4013-b3ad-4c4bfd533392 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:46.753016 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537d951-a594-4137-820f-0f1386731e89 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:46.789562 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73227eeb-7038-42d6-8e41-186be0247a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:46.790346 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73227eeb-7038-42d6-8e41-186be0247a7d None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:46.790674 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73227eeb-7038-42d6-8e41-186be0247a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:46.791414 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73227eeb-7038-42d6-8e41-186be0247a7d None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:46.791964 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73227eeb-7038-42d6-8e41-186be0247a7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:46.794101 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73227eeb-7038-42d6-8e41-186be0247a7d None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:46.799573 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 328/664] 10.222.0.40 () {56 vars in 1087 bytes} [Sun Oct 30 00:43:46 2022] GET /identity/v3/services => generated 1029 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:43:46.800356 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73227eeb-7038-42d6-8e41-186be0247a7d None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:46.802966 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:46.872606 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cb37f-82f5-4013-b3ad-4c4bfd533392 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:46.914657 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:46.922829 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1993747-0609-4294-98a9-403a1fbf666b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:46.923826 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1993747-0609-4294-98a9-403a1fbf666b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:46.924266 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1993747-0609-4294-98a9-403a1fbf666b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:46.924855 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1993747-0609-4294-98a9-403a1fbf666b None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:46.926058 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1993747-0609-4294-98a9-403a1fbf666b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:46.926526 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1993747-0609-4294-98a9-403a1fbf666b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:46.928513 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1993747-0609-4294-98a9-403a1fbf666b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:46.941240 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 337/665] 10.222.0.40 () {56 vars in 1122 bytes} [Sun Oct 30 00:43:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:46.942717 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1993747-0609-4294-98a9-403a1fbf666b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:46.946220 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73227eeb-7038-42d6-8e41-186be0247a7d None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:46.985167 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df5113-d13c-49d0-96a2-4e95db1192fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:46.985979 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df5113-d13c-49d0-96a2-4e95db1192fc None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:46.986427 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df5113-d13c-49d0-96a2-4e95db1192fc None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:46.986797 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df5113-d13c-49d0-96a2-4e95db1192fc None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:46.987573 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df5113-d13c-49d0-96a2-4e95db1192fc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:46.987972 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df5113-d13c-49d0-96a2-4e95db1192fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:46.989498 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df5113-d13c-49d0-96a2-4e95db1192fc None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:46.994404 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 329/666] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Oct 30 00:43:46 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:47.077493 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1993747-0609-4294-98a9-403a1fbf666b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:47.116768 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5656f-8ab9-470d-888c-d41955c42352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:47.117400 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5656f-8ab9-470d-888c-d41955c42352 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:47.117675 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5656f-8ab9-470d-888c-d41955c42352 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:47.117942 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5656f-8ab9-470d-888c-d41955c42352 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:47.118574 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5656f-8ab9-470d-888c-d41955c42352 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:47.118870 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5656f-8ab9-470d-888c-d41955c42352 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:47.120264 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5656f-8ab9-470d-888c-d41955c42352 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:47.126101 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 338/667] 10.222.0.40 () {56 vars in 1122 bytes} [Sun Oct 30 00:43:46 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:43:48.636865 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a4ab2-ceb8-4782-9ebd-871d43db0de8 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:48.637412 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a4ab2-ceb8-4782-9ebd-871d43db0de8 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:48.637412 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a4ab2-ceb8-4782-9ebd-871d43db0de8 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:48.638887 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 330/668] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:48.644425 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19bc296-7d39-4690-97ad-55265f6294b0 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:48.644826 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19bc296-7d39-4690-97ad-55265f6294b0 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:48.644991 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19bc296-7d39-4690-97ad-55265f6294b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:48.668206 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-d19bc296-7d39-4690-97ad-55265f6294b0 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:48.669434 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d19bc296-7d39-4690-97ad-55265f6294b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:48.729335 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:48.742331 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 339/669] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:48 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:43:49.015019 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a4ab2-ceb8-4782-9ebd-871d43db0de8 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:49.088752 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:49.097643 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d066a-5973-4d57-96b0-38bafee46a05 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:49.097943 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d066a-5973-4d57-96b0-38bafee46a05 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:49.098199 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d066a-5973-4d57-96b0-38bafee46a05 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:49.099982 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 340/670] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:49.105711 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e137c-8840-4afd-a0f4-0eda04324bd2 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:49.106000 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e137c-8840-4afd-a0f4-0eda04324bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:49.106274 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e137c-8840-4afd-a0f4-0eda04324bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:49.126844 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-643e137c-8840-4afd-a0f4-0eda04324bd2 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:49.128033 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-643e137c-8840-4afd-a0f4-0eda04324bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:49.128143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a4ab2-ceb8-4782-9ebd-871d43db0de8 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:49.164958 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cc40c-1504-44bb-9293-62bdf6b5d5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:49.165610 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cc40c-1504-44bb-9293-62bdf6b5d5f5 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:49.165885 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cc40c-1504-44bb-9293-62bdf6b5d5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:49.166151 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cc40c-1504-44bb-9293-62bdf6b5d5f5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:49.177288 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84cc40c-1504-44bb-9293-62bdf6b5d5f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:43:49.181993 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-e84cc40c-1504-44bb-9293-62bdf6b5d5f5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 30 00:43:49.181993 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:49.181993 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:49.181993 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:49.181993 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:49.181993 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:49.181993 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:49.181993 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:49.181993 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:49.181993 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:49.181993 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:49.181993 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:49.181993 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:43:49.181993 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:43:49.181993 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:43:49.181993 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:43:49.183135 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:43:49.183135 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:43:49.183135 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:43:49.183135 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:43:49.183135 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:49.183135 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:49.183135 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:49.183135 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:49.183135 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:49.183135 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:49.183135 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:49.183135 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:49.183135 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:49.183135 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:49.183135 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:49.183135 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:49.183989 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:49.183989 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:49.183989 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:49.183989 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:49.183989 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:43:49.183989 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:43:49.183989 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:43:49.183989 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:43:49.183989 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:43:49.183989 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:43:49.183989 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 30 00:43:49.183989 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:49.183989 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 331/671] 10.222.0.40 () {56 vars in 1120 bytes} [Sun Oct 30 00:43:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:49.184678 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e399fe1-54d8-4646-b1da-92448b8f00c7 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:49.184678 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e399fe1-54d8-4646-b1da-92448b8f00c7 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:49.184814 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e399fe1-54d8-4646-b1da-92448b8f00c7 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:49.189213 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 332/672] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:49.189829 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e399fe1-54d8-4646-b1da-92448b8f00c7 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:49.203931 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 341/673] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:49 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:43:49.205214 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edeb12-71b4-479f-9370-ca342bc596de None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:49.205502 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edeb12-71b4-479f-9370-ca342bc596de None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:49.205771 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edeb12-71b4-479f-9370-ca342bc596de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:49.226984 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-54edeb12-71b4-479f-9370-ca342bc596de None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:49.228313 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-54edeb12-71b4-479f-9370-ca342bc596de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:49.325668 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 342/674] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:49 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:43:49.337370 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762974e-3ccf-4c27-b9cd-dce377624c34 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:49.337370 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762974e-3ccf-4c27-b9cd-dce377624c34 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:49.337370 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762974e-3ccf-4c27-b9cd-dce377624c34 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:49.338589 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 343/675] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:43:49.339368 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e399fe1-54d8-4646-b1da-92448b8f00c7 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:49.345738 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961f41d-4278-4ce2-b104-6d14d08c91d0 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:49.346013 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961f41d-4278-4ce2-b104-6d14d08c91d0 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:49.346285 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961f41d-4278-4ce2-b104-6d14d08c91d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:49.365433 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-9961f41d-4278-4ce2-b104-6d14d08c91d0 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:49.366604 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9961f41d-4278-4ce2-b104-6d14d08c91d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:49.367685 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:49.378786 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3960b3-92d9-4d58-8035-767bd6b8c071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:49.379723 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3960b3-92d9-4d58-8035-767bd6b8c071 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:49.380181 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3960b3-92d9-4d58-8035-767bd6b8c071 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:49.380639 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3960b3-92d9-4d58-8035-767bd6b8c071 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:49.381498 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3960b3-92d9-4d58-8035-767bd6b8c071 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:49.382025 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3960b3-92d9-4d58-8035-767bd6b8c071 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:49.383572 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3960b3-92d9-4d58-8035-767bd6b8c071 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:49.393260 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 333/676] 10.222.0.40 () {56 vars in 1115 bytes} [Sun Oct 30 00:43:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:43:49.398766 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3960b3-92d9-4d58-8035-767bd6b8c071 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:49.416435 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:49.445238 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 344/677] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:49 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:43:49.490366 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961f41d-4278-4ce2-b104-6d14d08c91d0 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:49.507046 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3960b3-92d9-4d58-8035-767bd6b8c071 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:49.549666 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6a32e-157d-4e53-912d-7b60ab2376ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:49.550854 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6a32e-157d-4e53-912d-7b60ab2376ae None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:49.551527 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6a32e-157d-4e53-912d-7b60ab2376ae None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:49.551971 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6a32e-157d-4e53-912d-7b60ab2376ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:49.564578 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6a32e-157d-4e53-912d-7b60ab2376ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:49.566793 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6a32e-157d-4e53-912d-7b60ab2376ae None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:49.584684 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-d6e6a32e-157d-4e53-912d-7b60ab2376ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:49.584684 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:49.584684 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:49.584684 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:49.584684 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:49.584684 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:49.584684 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:49.584684 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:49.584684 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:49.584684 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:49.584684 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:49.584684 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:49.584684 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:49.584684 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:49.584684 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:49.584684 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:49.585842 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:49.585842 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:49.585842 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:49.585842 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:49.585842 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:49.585842 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:49.585842 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:49.585842 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:49.585842 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:49.585842 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:49.585842 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:49.585842 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:49.585842 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:49.585842 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:49.585842 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:49.585842 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:49.585842 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:49.587013 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:49.587013 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:49.587013 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:49.589303 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 334/678] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:43:49.598406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6a32e-157d-4e53-912d-7b60ab2376ae None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:49.617974 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961f41d-4278-4ce2-b104-6d14d08c91d0 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:49.642838 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:49.660140 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68087cd-cd0e-454a-96b8-d39abda851de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:49.660764 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68087cd-cd0e-454a-96b8-d39abda851de None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:49.661043 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68087cd-cd0e-454a-96b8-d39abda851de None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:49.661343 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68087cd-cd0e-454a-96b8-d39abda851de None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:49.664458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68087cd-cd0e-454a-96b8-d39abda851de None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:49.664458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68087cd-cd0e-454a-96b8-d39abda851de None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:49.675287 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-b68087cd-cd0e-454a-96b8-d39abda851de None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 30 00:43:49.675287 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:49.675287 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:43:49.675287 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:43:49.675287 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:43:49.675287 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:43:49.675287 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:43:49.675287 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:49.675287 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 30 00:43:49.675287 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:49.675287 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:43:49.675287 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:49.675287 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:49.675287 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:49.675287 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:49.675287 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:49.676259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:49.676259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:49.676259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:49.676259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:49.676259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:49.676259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:49.676259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:49.676259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:43:49.676259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:43:49.676259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:43:49.676259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:43:49.676259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:49.676259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:49.676259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:49.676259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:49.676259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:49.676259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:49.682073 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:49.682073 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:49.682073 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:49.682073 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:49.682073 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:49.682073 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:49.682073 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:49.682073 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:49.682073 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:49.682073 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:49.682073 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:43:49.682073 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:49.682073 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 30 00:43:49.682073 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:49.682073 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 345/679] 10.222.0.40 () {56 vars in 1132 bytes} [Sun Oct 30 00:43:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:43:49.683842 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68087cd-cd0e-454a-96b8-d39abda851de None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:49.711596 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6a32e-157d-4e53-912d-7b60ab2376ae None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:49.728262 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:49.747039 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d40e4b-73d6-4266-b47f-b66f1e7e4533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:49.747626 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d40e4b-73d6-4266-b47f-b66f1e7e4533 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:49.747898 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d40e4b-73d6-4266-b47f-b66f1e7e4533 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:49.748165 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d40e4b-73d6-4266-b47f-b66f1e7e4533 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:49.748786 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d40e4b-73d6-4266-b47f-b66f1e7e4533 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:49.749079 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d40e4b-73d6-4266-b47f-b66f1e7e4533 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:49.750460 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d40e4b-73d6-4266-b47f-b66f1e7e4533 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:49.761814 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 335/680] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:43:49.762671 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d40e4b-73d6-4266-b47f-b66f1e7e4533 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:49.785727 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68087cd-cd0e-454a-96b8-d39abda851de None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:49.818674 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf77bf-a4a8-4956-be27-7f09993766c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:49.819273 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf77bf-a4a8-4956-be27-7f09993766c8 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:49.819550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf77bf-a4a8-4956-be27-7f09993766c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:49.819820 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf77bf-a4a8-4956-be27-7f09993766c8 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:49.820458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf77bf-a4a8-4956-be27-7f09993766c8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:49.821856 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf77bf-a4a8-4956-be27-7f09993766c8 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:49.836745 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 346/681] 10.222.0.40 () {60 vars in 1141 bytes} [Sun Oct 30 00:43:49 2022] POST /identity/v3/services => generated 251 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:43:49.837735 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf77bf-a4a8-4956-be27-7f09993766c8 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:49.865397 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:49.869567 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d40e4b-73d6-4266-b47f-b66f1e7e4533 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:49.920857 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84173f7d-6d38-4ed0-a3be-a5e6c05bcf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:49.921503 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84173f7d-6d38-4ed0-a3be-a5e6c05bcf7f None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:49.921785 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84173f7d-6d38-4ed0-a3be-a5e6c05bcf7f None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:49.922054 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84173f7d-6d38-4ed0-a3be-a5e6c05bcf7f None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:49.922683 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84173f7d-6d38-4ed0-a3be-a5e6c05bcf7f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:49.922986 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84173f7d-6d38-4ed0-a3be-a5e6c05bcf7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:49.924386 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84173f7d-6d38-4ed0-a3be-a5e6c05bcf7f None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:49.934453 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 336/682] 10.222.0.40 () {56 vars in 1126 bytes} [Sun Oct 30 00:43:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:49.934453 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84173f7d-6d38-4ed0-a3be-a5e6c05bcf7f None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:49.965498 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf77bf-a4a8-4956-be27-7f09993766c8 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:49.969040 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:50.006192 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2930a-a380-446e-a29d-0fb68d94f82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:50.006866 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2930a-a380-446e-a29d-0fb68d94f82b None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:50.007149 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2930a-a380-446e-a29d-0fb68d94f82b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:50.007421 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2930a-a380-446e-a29d-0fb68d94f82b None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:50.008069 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2930a-a380-446e-a29d-0fb68d94f82b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:50.009468 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2930a-a380-446e-a29d-0fb68d94f82b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:50.026240 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 347/683] 10.222.0.40 () {60 vars in 1141 bytes} [Sun Oct 30 00:43:49 2022] POST /identity/v3/services => generated 241 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:43:50.027458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2930a-a380-446e-a29d-0fb68d94f82b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:50.053448 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84173f7d-6d38-4ed0-a3be-a5e6c05bcf7f None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:50.106151 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd701df4-13e2-4e9e-b314-65807bb9a72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:50.106813 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd701df4-13e2-4e9e-b314-65807bb9a72b None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:50.107152 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd701df4-13e2-4e9e-b314-65807bb9a72b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:50.107486 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd701df4-13e2-4e9e-b314-65807bb9a72b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:50.117333 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd701df4-13e2-4e9e-b314-65807bb9a72b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:50.119290 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd701df4-13e2-4e9e-b314-65807bb9a72b None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:50.134211 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-bd701df4-13e2-4e9e-b314-65807bb9a72b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 30 00:43:50.134211 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:50.134211 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:50.134211 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:50.134211 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:50.134211 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:50.134211 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:50.134211 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:50.134211 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:50.134211 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:50.134211 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:50.134211 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:50.134211 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:43:50.134211 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:43:50.134211 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:43:50.134211 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:43:50.135266 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:50.135266 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:50.135266 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:43:50.135266 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:50.135266 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:43:50.135266 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:43:50.135266 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:50.135266 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:50.135266 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:50.135266 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:50.135266 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:50.135266 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:50.135266 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:50.135266 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:50.135266 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:50.135266 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:50.135266 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:50.135266 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:50.136795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:50.136795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:50.136795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:43:50.136795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:43:50.136795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:43:50.136795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:43:50.136795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:43:50.136795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:43:50.136795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 30 00:43:50.136795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:50.136795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 337/684] 10.222.0.40 () {56 vars in 1117 bytes} [Sun Oct 30 00:43:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:50.141099 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd701df4-13e2-4e9e-b314-65807bb9a72b None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:50.165005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:50.171229 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2930a-a380-446e-a29d-0fb68d94f82b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:50.209532 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b85980-a4eb-4878-b43b-503bc656dda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:50.210146 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b85980-a4eb-4878-b43b-503bc656dda3 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:50.210424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b85980-a4eb-4878-b43b-503bc656dda3 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:50.210694 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b85980-a4eb-4878-b43b-503bc656dda3 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:50.211319 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b85980-a4eb-4878-b43b-503bc656dda3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:50.211619 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b85980-a4eb-4878-b43b-503bc656dda3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:50.213000 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b85980-a4eb-4878-b43b-503bc656dda3 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:50.219563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 348/685] 10.222.0.40 () {56 vars in 1126 bytes} [Sun Oct 30 00:43:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:50.224880 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b85980-a4eb-4878-b43b-503bc656dda3 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:50.261703 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:50.267222 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd701df4-13e2-4e9e-b314-65807bb9a72b None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:50.318676 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9e4a6-e6c0-43dd-90c9-2c13447efe0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:50.319275 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9e4a6-e6c0-43dd-90c9-2c13447efe0b None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:50.319574 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9e4a6-e6c0-43dd-90c9-2c13447efe0b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:50.319845 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9e4a6-e6c0-43dd-90c9-2c13447efe0b None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:50.320566 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9e4a6-e6c0-43dd-90c9-2c13447efe0b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:50.320865 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9e4a6-e6c0-43dd-90c9-2c13447efe0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:50.322420 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9e4a6-e6c0-43dd-90c9-2c13447efe0b None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:50.345556 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 338/686] 10.222.0.40 () {56 vars in 1149 bytes} [Sun Oct 30 00:43:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:50.347060 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9e4a6-e6c0-43dd-90c9-2c13447efe0b None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:50.357509 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b85980-a4eb-4878-b43b-503bc656dda3 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:50.404466 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c5b1f-344f-4da0-a4c0-3f6bd0ee64f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:50.405440 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c5b1f-344f-4da0-a4c0-3f6bd0ee64f4 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:50.406336 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c5b1f-344f-4da0-a4c0-3f6bd0ee64f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:50.406812 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c5b1f-344f-4da0-a4c0-3f6bd0ee64f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:50.407914 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c5b1f-344f-4da0-a4c0-3f6bd0ee64f4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:50.410134 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c5b1f-344f-4da0-a4c0-3f6bd0ee64f4 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:50.434236 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:50.441230 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 349/687] 10.222.0.40 () {60 vars in 1144 bytes} [Sun Oct 30 00:43:50 2022] POST /identity/v3/endpoints => generated 347 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:43:50.470048 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9e4a6-e6c0-43dd-90c9-2c13447efe0b None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:50.514946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e03c57-c2d7-4a3a-abbb-2c6eb4ba0693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:50.515545 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e03c57-c2d7-4a3a-abbb-2c6eb4ba0693 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:50.515820 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e03c57-c2d7-4a3a-abbb-2c6eb4ba0693 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:50.516084 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e03c57-c2d7-4a3a-abbb-2c6eb4ba0693 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:50.591047 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e03c57-c2d7-4a3a-abbb-2c6eb4ba0693 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:50.592494 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e03c57-c2d7-4a3a-abbb-2c6eb4ba0693 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:50.677994 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:50.717304 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 339/688] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Oct 30 00:43:50 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 30 00:43:50.722870 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c5b1f-344f-4da0-a4c0-3f6bd0ee64f4 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:50.817271 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:50.836818 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c5b1f-344f-4da0-a4c0-3f6bd0ee64f4 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:50.871567 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856bd4b-5212-4f31-8f70-4863a6f75835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:50.872191 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856bd4b-5212-4f31-8f70-4863a6f75835 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:50.872468 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856bd4b-5212-4f31-8f70-4863a6f75835 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:50.872732 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856bd4b-5212-4f31-8f70-4863a6f75835 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:50.883651 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856bd4b-5212-4f31-8f70-4863a6f75835 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:50.885091 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856bd4b-5212-4f31-8f70-4863a6f75835 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:50.900027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-c856bd4b-5212-4f31-8f70-4863a6f75835 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:50.900027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:50.900027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:50.900027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:50.900027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:50.900027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:50.900027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:50.900027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:50.900027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:50.900027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:50.900027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:50.900027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:50.900027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:43:50.900027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:43:50.900027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:43:50.900027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:43:50.901029 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:50.901029 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:50.901029 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:50.901029 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:50.901029 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:50.901029 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:50.901029 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:50.901029 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:50.901029 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:50.901029 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:50.901029 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:50.901029 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:50.901029 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:50.901029 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:50.901029 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:50.901029 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:50.901029 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:43:50.902072 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:43:50.902072 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:43:50.902072 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:50.902072 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 350/689] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:50.907154 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e03c57-c2d7-4a3a-abbb-2c6eb4ba0693 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:51.013885 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e03c57-c2d7-4a3a-abbb-2c6eb4ba0693 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:51.050610 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a6471-45d4-4c6b-b9bb-c27805078a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:51.051200 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a6471-45d4-4c6b-b9bb-c27805078a23 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:51.051473 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a6471-45d4-4c6b-b9bb-c27805078a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:51.051738 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a6471-45d4-4c6b-b9bb-c27805078a23 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:51.052364 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a6471-45d4-4c6b-b9bb-c27805078a23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:51.052710 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a6471-45d4-4c6b-b9bb-c27805078a23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:51.054107 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a6471-45d4-4c6b-b9bb-c27805078a23 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:51.066887 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 340/690] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:51.072247 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856bd4b-5212-4f31-8f70-4863a6f75835 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:51.178163 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856bd4b-5212-4f31-8f70-4863a6f75835 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:51.213659 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc966de4-a56b-4f2a-a7be-cd963c311a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:51.214915 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc966de4-a56b-4f2a-a7be-cd963c311a9d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:51.215191 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc966de4-a56b-4f2a-a7be-cd963c311a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:51.215445 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc966de4-a56b-4f2a-a7be-cd963c311a9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:51.218213 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:51.224550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc966de4-a56b-4f2a-a7be-cd963c311a9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:51.226010 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc966de4-a56b-4f2a-a7be-cd963c311a9d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:51.237483 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-cc966de4-a56b-4f2a-a7be-cd963c311a9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:51.237483 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:51.237483 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:51.237483 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:51.237483 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:51.237483 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:51.237483 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:51.237483 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:51.237483 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:51.237483 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:51.237483 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:51.237483 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:51.237483 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:43:51.237483 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:43:51.237483 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:43:51.238426 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:43:51.238426 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:51.238426 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:51.238426 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:51.238426 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:51.238426 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:51.238426 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:51.238426 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:51.238426 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:51.238426 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:51.238426 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:51.238426 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:51.238426 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:51.238426 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:51.238426 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:51.238426 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:51.238426 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:51.239310 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:43:51.239310 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:43:51.239310 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:43:51.239310 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:43:51.239310 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:43:51.239310 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:43:51.239310 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:43:51.239310 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:51.239310 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 351/691] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:43:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:51.246780 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a6471-45d4-4c6b-b9bb-c27805078a23 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:51.280080 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:51.351208 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a6471-45d4-4c6b-b9bb-c27805078a23 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:51.385119 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e3cbe-5574-4ea5-9977-c34ce3850bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:51.385802 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e3cbe-5574-4ea5-9977-c34ce3850bdd None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:51.386615 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e3cbe-5574-4ea5-9977-c34ce3850bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:51.386882 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e3cbe-5574-4ea5-9977-c34ce3850bdd None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:51.387558 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e3cbe-5574-4ea5-9977-c34ce3850bdd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:51.387854 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e3cbe-5574-4ea5-9977-c34ce3850bdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:51.389293 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e3cbe-5574-4ea5-9977-c34ce3850bdd None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:51.401757 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 341/692] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Oct 30 00:43:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:51.408255 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc966de4-a56b-4f2a-a7be-cd963c311a9d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:51.513025 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc966de4-a56b-4f2a-a7be-cd963c311a9d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:51.549848 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95775acd-a359-41f5-91a7-71a0da58e66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:51.550365 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95775acd-a359-41f5-91a7-71a0da58e66c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:51.550642 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95775acd-a359-41f5-91a7-71a0da58e66c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:51.550911 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95775acd-a359-41f5-91a7-71a0da58e66c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:51.551628 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95775acd-a359-41f5-91a7-71a0da58e66c None admin] RBAC: Adding query filter params (role.id=c80cdb94073e47d0845175cf6e618c64, scope.project.id=8969ed754fe24784a2025cbdbf6f1a8b, user.id=c625c9434922494aa868f1a5511963f3) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:51.551928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95775acd-a359-41f5-91a7-71a0da58e66c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:51.553481 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95775acd-a359-41f5-91a7-71a0da58e66c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:51.561290 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 352/693] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Oct 30 00:43:51 2022] GET /identity/v3/role_assignments?user.id=c625c9434922494aa868f1a5511963f3&scope.project.id=8969ed754fe24784a2025cbdbf6f1a8b&role.id=c80cdb94073e47d0845175cf6e618c64 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:52.181890 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34aa4d-0b97-434b-849e-f4378758e98e None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:52.182411 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34aa4d-0b97-434b-849e-f4378758e98e None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:52.182411 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34aa4d-0b97-434b-849e-f4378758e98e None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:52.184574 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 342/694] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:52.190220 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf964b-e079-45d9-a1ff-7a3efcc4a94b None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:52.190729 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf964b-e079-45d9-a1ff-7a3efcc4a94b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:52.190885 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf964b-e079-45d9-a1ff-7a3efcc4a94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:52.209365 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-7acf964b-e079-45d9-a1ff-7a3efcc4a94b None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:52.210536 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7acf964b-e079-45d9-a1ff-7a3efcc4a94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:52.270078 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:52.270620 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75d1cb-b29d-4dab-9af9-a1298e3a0c5e None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:52.270909 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75d1cb-b29d-4dab-9af9-a1298e3a0c5e None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:52.271188 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75d1cb-b29d-4dab-9af9-a1298e3a0c5e None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:52.272636 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 343/695] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:43:52.278398 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f34e6-417b-4b1b-9df4-c42aa9a7c1c5 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:52.278701 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f34e6-417b-4b1b-9df4-c42aa9a7c1c5 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:52.278938 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f34e6-417b-4b1b-9df4-c42aa9a7c1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:52.288332 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 353/696] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:43:52.303440 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-fc1f34e6-417b-4b1b-9df4-c42aa9a7c1c5 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:52.304616 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-fc1f34e6-417b-4b1b-9df4-c42aa9a7c1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:52.376570 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 344/697] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:43:52.562147 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf964b-e079-45d9-a1ff-7a3efcc4a94b None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:52.647303 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f34e6-417b-4b1b-9df4-c42aa9a7c1c5 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:52.673462 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:52.678572 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf964b-e079-45d9-a1ff-7a3efcc4a94b None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:52.719026 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600841b-aad8-4393-a2b0-27818f365d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:52.719668 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600841b-aad8-4393-a2b0-27818f365d39 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:52.719941 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600841b-aad8-4393-a2b0-27818f365d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:52.720207 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600841b-aad8-4393-a2b0-27818f365d39 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:52.720795 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600841b-aad8-4393-a2b0-27818f365d39 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:52.722684 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600841b-aad8-4393-a2b0-27818f365d39 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:52.732722 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-8600841b-aad8-4393-a2b0-27818f365d39 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 30 00:43:52.732722 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:52.732722 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:43:52.732722 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:43:52.732722 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:43:52.732722 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:43:52.732722 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:43:52.732722 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:52.732722 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 30 00:43:52.732722 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:52.732722 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:43:52.732722 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:52.732722 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:52.732722 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:52.732722 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:52.732722 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:52.732722 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:52.733868 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:52.733868 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:52.733868 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:52.733868 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:52.733868 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:52.733868 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:52.733868 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:43:52.733868 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:43:52.733868 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:43:52.733868 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:43:52.733868 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:52.733868 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:52.733868 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:52.733868 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:52.733868 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:52.733868 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:52.734717 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:52.734717 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:52.734717 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:52.734717 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:52.734717 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:52.734717 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:52.734717 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:52.734717 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:52.734717 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:52.734717 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:52.734717 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:43:52.734717 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:52.734717 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 30 00:43:52.734717 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:52.734717 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 354/698] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Oct 30 00:43:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:52.740927 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600841b-aad8-4393-a2b0-27818f365d39 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:52.783507 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f34e6-417b-4b1b-9df4-c42aa9a7c1c5 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:52.807856 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:52.832141 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863c650-ef7e-45ad-988e-34873a409048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:52.833108 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863c650-ef7e-45ad-988e-34873a409048 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:52.833629 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863c650-ef7e-45ad-988e-34873a409048 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:52.834166 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863c650-ef7e-45ad-988e-34873a409048 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:52.834926 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863c650-ef7e-45ad-988e-34873a409048 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:52.836800 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863c650-ef7e-45ad-988e-34873a409048 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:52.849034 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-c863c650-ef7e-45ad-988e-34873a409048 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:43:52.849034 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:52.849034 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:43:52.849034 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:43:52.849034 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:43:52.849034 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:43:52.849034 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:43:52.849034 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:52.849034 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:43:52.849034 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:52.849034 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:43:52.849034 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:52.849034 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:52.849034 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:52.849034 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:52.849034 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:52.849034 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:52.850162 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:52.850162 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:52.850162 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:52.850162 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:52.850162 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:52.850162 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:52.850162 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:43:52.850162 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:43:52.850162 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:43:52.850162 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:43:52.850162 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:52.850162 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:52.850162 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:52.850162 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:52.850162 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:52.850162 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:52.851093 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:52.851093 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:52.851093 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:52.851093 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:52.851093 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:52.851093 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:52.851093 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:52.851093 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:52.851093 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:52.851093 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:52.851093 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:43:52.851093 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:52.851093 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:43:52.851093 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:52.851093 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 345/699] 10.222.0.40 () {56 vars in 1126 bytes} [Sun Oct 30 00:43:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:52.852328 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3c4f1-3852-4b49-bdf4-190728e19447 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:52.852328 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3c4f1-3852-4b49-bdf4-190728e19447 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:52.852501 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3c4f1-3852-4b49-bdf4-190728e19447 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:52.853831 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 346/700] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:52.857929 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3c4f1-3852-4b49-bdf4-190728e19447 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:52.865737 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600841b-aad8-4393-a2b0-27818f365d39 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:52.905617 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70bddb-9f23-4a03-961f-b98300f6fdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:52.906201 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70bddb-9f23-4a03-961f-b98300f6fdc1 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:52.906488 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70bddb-9f23-4a03-961f-b98300f6fdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:52.906735 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70bddb-9f23-4a03-961f-b98300f6fdc1 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:52.907344 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70bddb-9f23-4a03-961f-b98300f6fdc1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:52.907638 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70bddb-9f23-4a03-961f-b98300f6fdc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:52.909092 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70bddb-9f23-4a03-961f-b98300f6fdc1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:52.913956 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 355/701] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Oct 30 00:43:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:52.915026 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c4e68-ef64-475b-baca-50d347e09959 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:52.915310 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c4e68-ef64-475b-baca-50d347e09959 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:52.915577 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c4e68-ef64-475b-baca-50d347e09959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:52.933685 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-7b7c4e68-ef64-475b-baca-50d347e09959 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:52.934871 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7b7c4e68-ef64-475b-baca-50d347e09959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:52.954699 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:52.975036 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3c4f1-3852-4b49-bdf4-190728e19447 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:53.003341 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 356/702] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:43:53.004492 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c4e68-ef64-475b-baca-50d347e09959 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:53.020755 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb7f51-a7b1-4d64-92d7-67cd0830cd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:53.021838 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb7f51-a7b1-4d64-92d7-67cd0830cd1f None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:53.022454 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb7f51-a7b1-4d64-92d7-67cd0830cd1f None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:53.022942 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb7f51-a7b1-4d64-92d7-67cd0830cd1f None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:53.023781 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb7f51-a7b1-4d64-92d7-67cd0830cd1f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:53.024419 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb7f51-a7b1-4d64-92d7-67cd0830cd1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:53.025860 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb7f51-a7b1-4d64-92d7-67cd0830cd1f None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:53.035880 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 347/703] 10.222.0.40 () {56 vars in 1122 bytes} [Sun Oct 30 00:43:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:43:53.038087 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb7f51-a7b1-4d64-92d7-67cd0830cd1f None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:53.070641 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:53.134511 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c4e68-ef64-475b-baca-50d347e09959 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:53.159308 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb7f51-a7b1-4d64-92d7-67cd0830cd1f None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:53.180004 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a46f3-a8ec-4a85-b77a-869e4bfca17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:53.180925 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a46f3-a8ec-4a85-b77a-869e4bfca17f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:53.181474 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a46f3-a8ec-4a85-b77a-869e4bfca17f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:53.182364 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a46f3-a8ec-4a85-b77a-869e4bfca17f None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:53.183422 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a46f3-a8ec-4a85-b77a-869e4bfca17f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:53.184034 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a46f3-a8ec-4a85-b77a-869e4bfca17f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:53.186133 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a46f3-a8ec-4a85-b77a-869e4bfca17f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:53.193137 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 357/704] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Oct 30 00:43:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:53.199347 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a46f3-a8ec-4a85-b77a-869e4bfca17f None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:53.204655 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb834f02-dc8d-4dcd-862d-a1b2b299f476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:53.205379 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb834f02-dc8d-4dcd-862d-a1b2b299f476 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:53.205700 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb834f02-dc8d-4dcd-862d-a1b2b299f476 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:53.205974 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb834f02-dc8d-4dcd-862d-a1b2b299f476 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:53.206608 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb834f02-dc8d-4dcd-862d-a1b2b299f476 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:53.206908 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb834f02-dc8d-4dcd-862d-a1b2b299f476 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:53.208396 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb834f02-dc8d-4dcd-862d-a1b2b299f476 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:53.220225 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 348/705] 10.222.0.40 () {56 vars in 1122 bytes} [Sun Oct 30 00:43:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:53.222163 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb834f02-dc8d-4dcd-862d-a1b2b299f476 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:53.241636 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:53.332994 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a46f3-a8ec-4a85-b77a-869e4bfca17f None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:53.341318 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb834f02-dc8d-4dcd-862d-a1b2b299f476 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:53.346280 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:53.367188 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc465570-56e8-474c-9f5b-b682767b7ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:53.367784 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc465570-56e8-474c-9f5b-b682767b7ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:53.368050 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc465570-56e8-474c-9f5b-b682767b7ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:53.368320 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc465570-56e8-474c-9f5b-b682767b7ca1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:53.369001 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc465570-56e8-474c-9f5b-b682767b7ca1 None admin] RBAC: Adding query filter params (interface=public, service_id=f880447fa6ed45318e666afacd18b181, region_id=RegionOne) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:53.369337 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc465570-56e8-474c-9f5b-b682767b7ca1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:53.371214 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc465570-56e8-474c-9f5b-b682767b7ca1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:53.376370 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 358/706] 10.222.0.40 () {56 vars in 1251 bytes} [Sun Oct 30 00:43:53 2022] GET /identity/v3/endpoints?service_id=f880447fa6ed45318e666afacd18b181&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:53.377134 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc465570-56e8-474c-9f5b-b682767b7ca1 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:53.385026 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f94128-a604-4d1e-8f4f-3510c166b575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:53.385985 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f94128-a604-4d1e-8f4f-3510c166b575 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:53.386233 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f94128-a604-4d1e-8f4f-3510c166b575 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:53.386498 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f94128-a604-4d1e-8f4f-3510c166b575 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:53.387188 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f94128-a604-4d1e-8f4f-3510c166b575 None admin] RBAC: Adding query filter params (interface=public, service_id=465a4ae202bf4332bf98b2c81d2c598d, region_id=RegionOne) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:53.387488 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f94128-a604-4d1e-8f4f-3510c166b575 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:53.388830 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f94128-a604-4d1e-8f4f-3510c166b575 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:53.396770 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 349/707] 10.222.0.40 () {56 vars in 1251 bytes} [Sun Oct 30 00:43:53 2022] GET /identity/v3/endpoints?service_id=465a4ae202bf4332bf98b2c81d2c598d&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:53.397647 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f94128-a604-4d1e-8f4f-3510c166b575 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:53.474636 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:53.489339 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc465570-56e8-474c-9f5b-b682767b7ca1 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:53.499051 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f94128-a604-4d1e-8f4f-3510c166b575 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:53.524453 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89898b-a8ba-4cee-816b-f55aa830c5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:53.525069 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89898b-a8ba-4cee-816b-f55aa830c5cc None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:53.525374 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89898b-a8ba-4cee-816b-f55aa830c5cc None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:53.525642 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89898b-a8ba-4cee-816b-f55aa830c5cc None admin] PATH_INFO: `/v3/services/compute` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:53.526231 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89898b-a8ba-4cee-816b-f55aa830c5cc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:53.528062 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89898b-a8ba-4cee-816b-f55aa830c5cc None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:53.534687 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a2233-4e64-4276-a999-78a546266ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:53.535367 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a2233-4e64-4276-a999-78a546266ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:53.535699 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a2233-4e64-4276-a999-78a546266ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:53.536038 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a2233-4e64-4276-a999-78a546266ed8 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:53.536538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-cd89898b-a8ba-4cee-816b-f55aa830c5cc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 30 00:43:53.536538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:53.536538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:43:53.536538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:43:53.536538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:43:53.536538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:43:53.536538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:43:53.536538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:53.536538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 30 00:43:53.536538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:53.536538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:43:53.536538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:53.536538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:53.536538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:53.536538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:53.536538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:53.536538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:53.537737 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:53.537737 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:53.537737 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:53.537737 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:53.537737 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:53.537737 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:53.537737 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:43:53.537737 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:43:53.537737 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:43:53.537737 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:43:53.537737 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:53.537737 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:53.537737 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:53.537737 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:53.537737 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:53.537737 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:53.538791 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:53.538791 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:53.538791 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:53.538791 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:53.538791 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:53.538791 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:53.538791 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:53.538791 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:53.538791 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:53.538791 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:53.538791 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:43:53.538791 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:53.538791 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 30 00:43:53.538791 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:53.539722 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a2233-4e64-4276-a999-78a546266ed8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:53.540010 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a2233-4e64-4276-a999-78a546266ed8 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:53.542712 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 359/708] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:43:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:53.543383 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89898b-a8ba-4cee-816b-f55aa830c5cc None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:53.557423 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 350/709] 10.222.0.40 () {56 vars in 1087 bytes} [Sun Oct 30 00:43:53 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:43:53.557423 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a2233-4e64-4276-a999-78a546266ed8 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:53.607640 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:53.691826 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a2233-4e64-4276-a999-78a546266ed8 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:53.696428 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89898b-a8ba-4cee-816b-f55aa830c5cc None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:53.737075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf1cb6-e880-4ed3-8fd1-357eb82ef7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:53.737970 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf1cb6-e880-4ed3-8fd1-357eb82ef7cf None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:53.738420 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf1cb6-e880-4ed3-8fd1-357eb82ef7cf None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:53.738843 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf1cb6-e880-4ed3-8fd1-357eb82ef7cf None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:53.739616 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf1cb6-e880-4ed3-8fd1-357eb82ef7cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:53.740452 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddcc249-1d62-4c85-b1aa-3f6c9fdc5e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:53.741177 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcc249-1d62-4c85-b1aa-3f6c9fdc5e0c None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:53.741512 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf1cb6-e880-4ed3-8fd1-357eb82ef7cf None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:53.741627 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcc249-1d62-4c85-b1aa-3f6c9fdc5e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:53.741991 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcc249-1d62-4c85-b1aa-3f6c9fdc5e0c None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:53.742731 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddcc249-1d62-4c85-b1aa-3f6c9fdc5e0c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:53.743112 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddcc249-1d62-4c85-b1aa-3f6c9fdc5e0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:53.744589 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddcc249-1d62-4c85-b1aa-3f6c9fdc5e0c None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:53.750909 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 360/710] 10.222.0.40 () {56 vars in 1087 bytes} [Sun Oct 30 00:43:53 2022] GET /identity/v3/services => generated 1497 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:43:53.755913 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 351/711] 10.222.0.40 () {56 vars in 1112 bytes} [Sun Oct 30 00:43:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:53.757176 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf1cb6-e880-4ed3-8fd1-357eb82ef7cf None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:53.773555 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6571cc4-6b78-407e-b977-43cd207b443d None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:53.774491 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6571cc4-6b78-407e-b977-43cd207b443d None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:53.775037 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6571cc4-6b78-407e-b977-43cd207b443d None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:53.776878 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 352/712] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:53.782916 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab925a-48e8-4f7f-ac56-64942a26b9e7 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:53.783225 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab925a-48e8-4f7f-ac56-64942a26b9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:53.783470 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab925a-48e8-4f7f-ac56-64942a26b9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:53.793178 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:53.805400 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-c6ab925a-48e8-4f7f-ac56-64942a26b9e7 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:53.806635 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c6ab925a-48e8-4f7f-ac56-64942a26b9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:53.893879 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 353/713] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:43:53.896329 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf1cb6-e880-4ed3-8fd1-357eb82ef7cf None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:53.905149 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:53.942484 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7008f-c1d7-41b9-9c49-b729a5215e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:53.943446 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7008f-c1d7-41b9-9c49-b729a5215e1d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:53.944031 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7008f-c1d7-41b9-9c49-b729a5215e1d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:53.944506 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7008f-c1d7-41b9-9c49-b729a5215e1d None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:53.945373 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e7008f-c1d7-41b9-9c49-b729a5215e1d None admin] RBAC: Adding query filter params (type=compute) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:53.945875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e7008f-c1d7-41b9-9c49-b729a5215e1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:53.947456 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e7008f-c1d7-41b9-9c49-b729a5215e1d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:53.952710 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 361/714] 10.222.0.40 () {56 vars in 1112 bytes} [Sun Oct 30 00:43:53 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:54.161969 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab925a-48e8-4f7f-ac56-64942a26b9e7 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:54.264975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab925a-48e8-4f7f-ac56-64942a26b9e7 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:54.301778 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee91490-bc13-4e37-8325-b8e47272de60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:54.302400 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee91490-bc13-4e37-8325-b8e47272de60 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:54.302670 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee91490-bc13-4e37-8325-b8e47272de60 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:54.302937 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee91490-bc13-4e37-8325-b8e47272de60 None admin] PATH_INFO: `/v3/services/image` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:54.303511 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee91490-bc13-4e37-8325-b8e47272de60 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:54.304858 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee91490-bc13-4e37-8325-b8e47272de60 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:54.306701 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:54.315452 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-aee91490-bc13-4e37-8325-b8e47272de60 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 30 00:43:54.315452 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:54.315452 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:43:54.315452 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:43:54.315452 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:43:54.315452 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:43:54.315452 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:43:54.315452 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:54.315452 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 30 00:43:54.315452 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:54.315452 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:43:54.315452 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:54.315452 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:54.315452 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:54.315452 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:54.315452 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:54.315452 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:54.316516 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:54.316516 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:54.316516 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:54.316516 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:54.316516 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:54.316516 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:54.316516 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:43:54.316516 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:43:54.316516 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:43:54.316516 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:43:54.316516 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:54.316516 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:54.316516 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:54.316516 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:54.316516 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:54.316516 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:54.317393 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:54.317393 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:54.317393 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:54.317393 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:54.317393 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:54.317393 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:54.317393 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:54.317393 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:54.317393 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:54.317393 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:54.317393 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:43:54.317393 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:54.317393 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 30 00:43:54.317393 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:54.317393 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 354/715] 10.222.0.40 () {56 vars in 1105 bytes} [Sun Oct 30 00:43:54 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:54.323210 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7008f-c1d7-41b9-9c49-b729a5215e1d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:54.436927 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7008f-c1d7-41b9-9c49-b729a5215e1d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:54.473056 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f44ad3-30b7-46be-afa4-fcddbaebd43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:54.473700 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f44ad3-30b7-46be-afa4-fcddbaebd43f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:54.473978 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f44ad3-30b7-46be-afa4-fcddbaebd43f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:54.474248 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f44ad3-30b7-46be-afa4-fcddbaebd43f None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:54.474876 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f44ad3-30b7-46be-afa4-fcddbaebd43f None admin] RBAC: Adding query filter params (name=image) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:54.475174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f44ad3-30b7-46be-afa4-fcddbaebd43f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:54.476526 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f44ad3-30b7-46be-afa4-fcddbaebd43f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:54.482376 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 362/716] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:54.490285 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee91490-bc13-4e37-8325-b8e47272de60 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:54.597305 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee91490-bc13-4e37-8325-b8e47272de60 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:54.632907 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15df06-34fd-4c8b-925a-07caf16e2296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:54.633539 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15df06-34fd-4c8b-925a-07caf16e2296 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:54.633923 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15df06-34fd-4c8b-925a-07caf16e2296 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:54.634203 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15df06-34fd-4c8b-925a-07caf16e2296 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:54.634869 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15df06-34fd-4c8b-925a-07caf16e2296 None admin] RBAC: Adding query filter params (type=image) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:54.635167 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15df06-34fd-4c8b-925a-07caf16e2296 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:54.636562 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15df06-34fd-4c8b-925a-07caf16e2296 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:54.641364 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 355/717] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:54 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:55.863419 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd63fff-906a-4e7e-b7df-51e5a52a3be8 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:55.863927 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd63fff-906a-4e7e-b7df-51e5a52a3be8 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:55.864005 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd63fff-906a-4e7e-b7df-51e5a52a3be8 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:55.865563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 363/718] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:55.871004 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c789ac8-1d0e-42b3-985e-7d7fea791282 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:55.871452 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c789ac8-1d0e-42b3-985e-7d7fea791282 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:55.871534 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c789ac8-1d0e-42b3-985e-7d7fea791282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:55.891717 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-2c789ac8-1d0e-42b3-985e-7d7fea791282 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:55.892934 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-2c789ac8-1d0e-42b3-985e-7d7fea791282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:55.954763 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:55.965977 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 356/719] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:43:56.005293 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ff5cd-ff56-445e-bbb3-6680fbd3cafb None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:56.005586 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ff5cd-ff56-445e-bbb3-6680fbd3cafb None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:56.005854 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ff5cd-ff56-445e-bbb3-6680fbd3cafb None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:56.007439 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 364/720] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:56.014617 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f63e4-4f98-40d9-bbf5-ba167f924871 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:56.014901 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f63e4-4f98-40d9-bbf5-ba167f924871 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:56.015174 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f63e4-4f98-40d9-bbf5-ba167f924871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:56.033746 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-df6f63e4-4f98-40d9-bbf5-ba167f924871 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:56.034922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-df6f63e4-4f98-40d9-bbf5-ba167f924871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:56.103868 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 357/721] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:43:56.224116 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc945c76-99a4-4e8b-b2f5-9066498045ca None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:56.224288 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc945c76-99a4-4e8b-b2f5-9066498045ca None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:56.224561 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc945c76-99a4-4e8b-b2f5-9066498045ca None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:56.226240 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 365/722] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:56.231604 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855db03-ab63-427c-955c-ad38e5049432 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:56.231986 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855db03-ab63-427c-955c-ad38e5049432 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:56.232355 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855db03-ab63-427c-955c-ad38e5049432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:56.240377 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc945c76-99a4-4e8b-b2f5-9066498045ca None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:56.254277 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-e855db03-ab63-427c-955c-ad38e5049432 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:56.255760 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-e855db03-ab63-427c-955c-ad38e5049432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:56.274024 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:56.345447 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 358/723] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:43:56.356481 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc945c76-99a4-4e8b-b2f5-9066498045ca None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:56.388588 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855db03-ab63-427c-955c-ad38e5049432 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:56.392315 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5953b8-8ef3-4c80-bbbb-45a42ba9db0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:56.393503 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5953b8-8ef3-4c80-bbbb-45a42ba9db0b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:56.393503 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5953b8-8ef3-4c80-bbbb-45a42ba9db0b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:56.393678 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5953b8-8ef3-4c80-bbbb-45a42ba9db0b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:56.394261 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5953b8-8ef3-4c80-bbbb-45a42ba9db0b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:56.395635 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5953b8-8ef3-4c80-bbbb-45a42ba9db0b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:56.405935 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-3b5953b8-8ef3-4c80-bbbb-45a42ba9db0b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 30 00:43:56.405935 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:56.405935 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:43:56.405935 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:43:56.405935 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:43:56.405935 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:43:56.405935 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:43:56.405935 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:56.405935 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 30 00:43:56.405935 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:56.405935 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:43:56.405935 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:56.405935 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:56.405935 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:56.405935 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:56.405935 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:56.405935 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:56.406992 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:56.406992 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:56.406992 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:56.406992 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:56.406992 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:56.406992 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:56.406992 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:43:56.406992 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:43:56.406992 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:43:56.406992 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:43:56.406992 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:56.406992 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:56.406992 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:56.406992 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:56.406992 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:56.406992 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:56.407836 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:56.407836 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:56.407836 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:56.407836 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:56.407836 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:56.407836 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:56.407836 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:56.407836 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:56.407836 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:56.407836 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:56.407836 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:43:56.407836 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:56.407836 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 30 00:43:56.407836 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:56.407836 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 366/724] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Oct 30 00:43:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:43:56.413329 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5953b8-8ef3-4c80-bbbb-45a42ba9db0b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:56.453717 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:56.507480 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855db03-ab63-427c-955c-ad38e5049432 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:56.517504 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:56.526761 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5953b8-8ef3-4c80-bbbb-45a42ba9db0b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:56.548166 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c0f48-db0a-494b-9279-c88595b7200d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:56.548946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c0f48-db0a-494b-9279-c88595b7200d None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:56.549708 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c0f48-db0a-494b-9279-c88595b7200d None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:56.550101 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c0f48-db0a-494b-9279-c88595b7200d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:56.550781 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c0f48-db0a-494b-9279-c88595b7200d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:56.552408 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c0f48-db0a-494b-9279-c88595b7200d None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:56.564338 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-814c0f48-db0a-494b-9279-c88595b7200d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:43:56.564338 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:56.564338 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:43:56.564338 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:43:56.564338 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:43:56.564338 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:43:56.564338 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:43:56.564338 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:56.564338 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:43:56.564338 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:56.564338 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:43:56.564338 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:56.564338 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:56.564338 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:56.564338 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:56.564338 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:56.564338 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:56.565642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:56.565642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:56.565642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:56.565642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:56.565642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:56.565642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:56.565642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:43:56.565642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:43:56.565642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:43:56.565642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:43:56.565642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:56.565642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:56.565642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:56.565642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:56.565642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:56.565642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:56.566714 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:56.566714 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:56.566714 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:56.566714 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:56.566714 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:56.566714 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:56.566714 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:56.566714 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:56.566714 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:56.566714 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:56.566714 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:43:56.566714 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:56.566714 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:43:56.566714 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:56.569334 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 359/725] 10.222.0.40 () {56 vars in 1126 bytes} [Sun Oct 30 00:43:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:43:56.574730 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c0f48-db0a-494b-9279-c88595b7200d None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:56.579880 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159878a3-5087-4a8e-a0d2-78786e9b2bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:56.580498 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159878a3-5087-4a8e-a0d2-78786e9b2bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:56.580787 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159878a3-5087-4a8e-a0d2-78786e9b2bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:56.581052 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159878a3-5087-4a8e-a0d2-78786e9b2bf9 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:56.581734 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159878a3-5087-4a8e-a0d2-78786e9b2bf9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:56.582036 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159878a3-5087-4a8e-a0d2-78786e9b2bf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:56.583408 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159878a3-5087-4a8e-a0d2-78786e9b2bf9 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:56.593331 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 367/726] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Oct 30 00:43:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:56.595577 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159878a3-5087-4a8e-a0d2-78786e9b2bf9 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:56.703218 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c0f48-db0a-494b-9279-c88595b7200d None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:56.721358 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159878a3-5087-4a8e-a0d2-78786e9b2bf9 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:56.721572 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:56.745992 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821365b2-607d-4443-a6f4-6015f5215805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:56.746593 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821365b2-607d-4443-a6f4-6015f5215805 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:56.746863 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821365b2-607d-4443-a6f4-6015f5215805 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:56.747127 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821365b2-607d-4443-a6f4-6015f5215805 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:56.747752 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821365b2-607d-4443-a6f4-6015f5215805 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:56.748035 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821365b2-607d-4443-a6f4-6015f5215805 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:56.749400 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821365b2-607d-4443-a6f4-6015f5215805 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:56.754660 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 360/727] 10.222.0.40 () {56 vars in 1122 bytes} [Sun Oct 30 00:43:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:43:56.755403 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821365b2-607d-4443-a6f4-6015f5215805 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:56.765158 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88d268-389e-43cf-8daa-4ed655e5856b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:56.766033 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88d268-389e-43cf-8daa-4ed655e5856b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:56.766513 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88d268-389e-43cf-8daa-4ed655e5856b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:56.766993 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88d268-389e-43cf-8daa-4ed655e5856b None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:56.767625 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88d268-389e-43cf-8daa-4ed655e5856b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:56.767957 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88d268-389e-43cf-8daa-4ed655e5856b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:56.769311 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88d268-389e-43cf-8daa-4ed655e5856b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:56.774508 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 368/728] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Oct 30 00:43:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:56.780547 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88d268-389e-43cf-8daa-4ed655e5856b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:56.806211 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:56.863502 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821365b2-607d-4443-a6f4-6015f5215805 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:56.881250 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88d268-389e-43cf-8daa-4ed655e5856b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:56.896675 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091e2ea-1688-4a12-a762-5aa16d019c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:56.897298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091e2ea-1688-4a12-a762-5aa16d019c05 None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:56.897576 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091e2ea-1688-4a12-a762-5aa16d019c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:56.897843 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091e2ea-1688-4a12-a762-5aa16d019c05 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:56.898484 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0091e2ea-1688-4a12-a762-5aa16d019c05 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:56.900079 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0091e2ea-1688-4a12-a762-5aa16d019c05 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:56.915496 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 361/729] 10.222.0.40 () {60 vars in 1141 bytes} [Sun Oct 30 00:43:56 2022] POST /identity/v3/services => generated 242 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:43:56.916084 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091e2ea-1688-4a12-a762-5aa16d019c05 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:56.930372 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a6f81-2dbb-4562-86f2-f706d02148ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:56.930993 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a6f81-2dbb-4562-86f2-f706d02148ad None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:56.931278 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a6f81-2dbb-4562-86f2-f706d02148ad None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:56.931531 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a6f81-2dbb-4562-86f2-f706d02148ad None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:56.932166 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a6f81-2dbb-4562-86f2-f706d02148ad None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:56.932577 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a6f81-2dbb-4562-86f2-f706d02148ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:56.934178 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a6f81-2dbb-4562-86f2-f706d02148ad None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:56.939916 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 369/730] 10.222.0.40 () {56 vars in 1122 bytes} [Sun Oct 30 00:43:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:56.943052 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14230e5-b77f-4a15-b615-68d535df7bce None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:56.943949 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14230e5-b77f-4a15-b615-68d535df7bce None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:56.944506 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14230e5-b77f-4a15-b615-68d535df7bce None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:56.946908 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 370/731] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:56.948147 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14230e5-b77f-4a15-b615-68d535df7bce None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:56.965064 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:57.033407 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091e2ea-1688-4a12-a762-5aa16d019c05 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:57.048918 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:57.067742 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14230e5-b77f-4a15-b615-68d535df7bce None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:57.072244 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165325d-fa2c-4ead-b90a-23298b83961b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:57.072849 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165325d-fa2c-4ead-b90a-23298b83961b None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:57.073118 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165325d-fa2c-4ead-b90a-23298b83961b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:57.073411 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165325d-fa2c-4ead-b90a-23298b83961b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:57.074632 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165325d-fa2c-4ead-b90a-23298b83961b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:57.076018 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165325d-fa2c-4ead-b90a-23298b83961b None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:57.100999 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 362/732] 10.222.0.40 () {60 vars in 1144 bytes} [Sun Oct 30 00:43:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:43:57.101523 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4da79-a194-457a-b064-b2ae5edec03f None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:57.101799 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4da79-a194-457a-b064-b2ae5edec03f None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:57.102071 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4da79-a194-457a-b064-b2ae5edec03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:57.122900 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-8ad4da79-a194-457a-b064-b2ae5edec03f None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:57.124103 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8ad4da79-a194-457a-b064-b2ae5edec03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:57.124249 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f753980-c687-43c4-9a8a-669b7a4c98c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:57.124907 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f753980-c687-43c4-9a8a-669b7a4c98c0 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:57.125348 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f753980-c687-43c4-9a8a-669b7a4c98c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:57.125725 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f753980-c687-43c4-9a8a-669b7a4c98c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:57.127513 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f753980-c687-43c4-9a8a-669b7a4c98c0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:57.129233 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f753980-c687-43c4-9a8a-669b7a4c98c0 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:57.154080 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 371/733] 10.222.0.40 () {60 vars in 1144 bytes} [Sun Oct 30 00:43:56 2022] POST /identity/v3/endpoints => generated 349 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:43:57.225662 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 363/734] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:57 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:43:57.494678 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f753980-c687-43c4-9a8a-669b7a4c98c0 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:57.603073 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f753980-c687-43c4-9a8a-669b7a4c98c0 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:57.639020 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd0c7c-8138-498b-b6e1-9b6963a536ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:57.639861 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd0c7c-8138-498b-b6e1-9b6963a536ee None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:57.640281 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd0c7c-8138-498b-b6e1-9b6963a536ee None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:57.640691 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd0c7c-8138-498b-b6e1-9b6963a536ee None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:57.641494 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd0c7c-8138-498b-b6e1-9b6963a536ee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:57.643009 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd0c7c-8138-498b-b6e1-9b6963a536ee None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:57.647724 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:57.664942 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 372/735] 10.222.0.40 () {60 vars in 1141 bytes} [Sun Oct 30 00:43:57 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:43:59.254727 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b050486-edac-4a8c-9af6-f70fc3d8e6f5 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:59.255601 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b050486-edac-4a8c-9af6-f70fc3d8e6f5 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:59.256015 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b050486-edac-4a8c-9af6-f70fc3d8e6f5 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:59.257767 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 364/736] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:59.263689 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fb38c-07b7-4b13-acf7-00813830ee58 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:59.264489 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fb38c-07b7-4b13-acf7-00813830ee58 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:59.264997 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fb38c-07b7-4b13-acf7-00813830ee58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:59.286522 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a58fb38c-07b7-4b13-acf7-00813830ee58 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:59.288102 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a58fb38c-07b7-4b13-acf7-00813830ee58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:59.377293 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 373/737] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:59 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:43:59.420419 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b895299-a87e-4e86-945b-b74769aa1b5c None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:59.420743 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b895299-a87e-4e86-945b-b74769aa1b5c None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:59.420969 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b895299-a87e-4e86-945b-b74769aa1b5c None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:59.422587 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 365/738] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:59.427863 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a461f7-20b8-4086-8c94-04cd9761292b None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:59.428150 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a461f7-20b8-4086-8c94-04cd9761292b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:59.428423 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a461f7-20b8-4086-8c94-04cd9761292b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:59.441816 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaac0d6-5454-4b08-8394-45a931bde36d None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:59.442083 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaac0d6-5454-4b08-8394-45a931bde36d None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:59.442355 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaac0d6-5454-4b08-8394-45a931bde36d None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:59.443912 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 366/739] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:43:59.447031 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a7a461f7-20b8-4086-8c94-04cd9761292b None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:59.448336 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a7a461f7-20b8-4086-8c94-04cd9761292b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:59.448743 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc4a82-a978-4c85-95ea-043e115862a2 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:59.449020 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc4a82-a978-4c85-95ea-043e115862a2 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:59.449326 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc4a82-a978-4c85-95ea-043e115862a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:59.469016 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-a0dc4a82-a978-4c85-95ea-043e115862a2 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:59.470210 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a0dc4a82-a978-4c85-95ea-043e115862a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:59.490497 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:59.520014 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 374/740] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:59 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:43:59.550870 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 367/741] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:59 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:43:59.659660 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a461f7-20b8-4086-8c94-04cd9761292b None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:59.723740 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:59.773312 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a461f7-20b8-4086-8c94-04cd9761292b None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:59.796218 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc4a82-a978-4c85-95ea-043e115862a2 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:59.814016 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46b721-c422-41f4-9f3c-e978f8849568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:59.814649 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46b721-c422-41f4-9f3c-e978f8849568 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:59.815039 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46b721-c422-41f4-9f3c-e978f8849568 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:59.815342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46b721-c422-41f4-9f3c-e978f8849568 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:59.816020 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46b721-c422-41f4-9f3c-e978f8849568 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:59.817675 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46b721-c422-41f4-9f3c-e978f8849568 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:59.829525 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-ea46b721-c422-41f4-9f3c-e978f8849568 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 30 00:43:59.829525 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:59.829525 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:43:59.829525 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:43:59.829525 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:43:59.829525 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:43:59.829525 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:43:59.829525 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:59.829525 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 30 00:43:59.829525 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:59.829525 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:43:59.829525 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:59.829525 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:59.829525 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:43:59.829525 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:43:59.829525 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:43:59.829525 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:43:59.830520 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:43:59.830520 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:43:59.830520 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:43:59.830520 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:43:59.830520 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:43:59.830520 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:43:59.830520 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:43:59.830520 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:43:59.830520 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:43:59.830520 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:43:59.830520 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:43:59.830520 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:43:59.830520 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:43:59.830520 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:43:59.830520 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:43:59.830520 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:43:59.831412 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:43:59.831412 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:43:59.831412 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:43:59.831412 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:43:59.831412 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:43:59.831412 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:43:59.831412 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:43:59.831412 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:43:59.831412 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:43:59.831412 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:43:59.831412 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:43:59.831412 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:43:59.831412 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 30 00:43:59.831412 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:43:59.834610 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 375/742] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:43:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:43:59.838020 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46b721-c422-41f4-9f3c-e978f8849568 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:59.914898 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc4a82-a978-4c85-95ea-043e115862a2 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:59.940909 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46b721-c422-41f4-9f3c-e978f8849568 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:59.956752 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:59.957875 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcb04b-266a-40ee-82e4-706aa655b3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:59.958538 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcb04b-266a-40ee-82e4-706aa655b3dc None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:59.958869 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcb04b-266a-40ee-82e4-706aa655b3dc None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:59.959145 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcb04b-266a-40ee-82e4-706aa655b3dc None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:59.959788 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbcb04b-266a-40ee-82e4-706aa655b3dc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:59.961275 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbcb04b-266a-40ee-82e4-706aa655b3dc None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:59.963877 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: WARNING keystone.server.flask.common [None req-afbcb04b-266a-40ee-82e4-706aa655b3dc None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 30 00:43:59.977377 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b7dd5-e807-4df8-bf60-6ff27f7eb03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:59.977980 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b7dd5-e807-4df8-bf60-6ff27f7eb03b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:59.978250 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b7dd5-e807-4df8-bf60-6ff27f7eb03b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:59.978514 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b7dd5-e807-4df8-bf60-6ff27f7eb03b None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:59.979248 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b7dd5-e807-4df8-bf60-6ff27f7eb03b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:43:59.979471 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b7dd5-e807-4df8-bf60-6ff27f7eb03b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:59.981507 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b7dd5-e807-4df8-bf60-6ff27f7eb03b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:59.982069 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.sql.core [None req-afbcb04b-266a-40ee-82e4-706aa655b3dc None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 30 00:43:59.982069 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 30 00:43:59.982069 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [parameters: {'id': 'bb2e6baf8c9644a3b09dfd5b3d6c3b84', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 30 00:43:59.982069 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81352) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 30 00:43:59.986845 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 376/743] 10.222.0.40 () {56 vars in 1112 bytes} [Sun Oct 30 00:43:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:43:59.987428 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b7dd5-e807-4df8-bf60-6ff27f7eb03b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:59.994451 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-afbcb04b-266a-40ee-82e4-706aa655b3dc None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bb2e6baf8c9644a3b09dfd5b3d6c3b84.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bb2e6baf8c9644a3b09dfd5b3d6c3b84. Oct 30 00:43:59.994451 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:59.994451 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 00:43:59.994451 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 00:43:59.994451 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 00:43:59.994451 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 00:43:59.994451 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 00:43:59.994451 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 00:43:59.994451 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 00:43:59.994451 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application conn.query(q) Oct 30 00:43:59.994451 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 00:43:59.994451 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 00:43:59.994451 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 00:43:59.995356 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application result.read() Oct 30 00:43:59.995356 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 00:43:59.995356 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 00:43:59.995356 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 00:43:59.995356 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 00:43:59.995356 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 00:43:59.995356 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 00:43:59.995356 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 00:43:59.995356 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 00:43:59.995356 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 30 00:43:59.995356 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:59.995356 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 30 00:43:59.995356 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:43:59.995356 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:43:59.995356 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 30 00:43:59.995356 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 30 00:43:59.995356 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 30 00:43:59.995356 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 30 00:43:59.997928 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 00:43:59.997928 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application next(self.gen) Oct 30 00:43:59.997928 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 30 00:43:59.997928 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application yield resource Oct 30 00:43:59.997928 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 00:43:59.997928 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application next(self.gen) Oct 30 00:43:59.997928 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 30 00:43:59.997928 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self.session.rollback() Oct 30 00:43:59.997928 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 00:43:59.997928 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self.force_reraise() Oct 30 00:43:59.997928 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 00:43:59.997928 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise self.value Oct 30 00:43:59.997928 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 30 00:43:59.997928 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 30 00:43:59.997928 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 30 00:43:59.997928 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application session.commit() Oct 30 00:43:59.997928 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 30 00:43:59.998841 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 30 00:43:59.998841 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 30 00:43:59.998841 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._prepare_impl() Oct 30 00:43:59.998841 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 30 00:43:59.998841 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self.session.flush() Oct 30 00:43:59.998841 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 30 00:43:59.998841 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._flush(objects) Oct 30 00:43:59.998841 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 30 00:43:59.998841 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 30 00:43:59.998841 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 30 00:43:59.998841 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application compat.raise_( Oct 30 00:43:59.998841 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 00:43:59.998841 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception Oct 30 00:43:59.998841 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 30 00:43:59.998841 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application flush_context.execute() Oct 30 00:43:59.998841 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 30 00:43:59.998841 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rec.execute(self) Oct 30 00:43:59.999729 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 30 00:43:59.999729 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 30 00:43:59.999729 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 30 00:43:59.999729 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 30 00:43:59.999729 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 30 00:43:59.999729 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 30 00:43:59.999729 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 30 00:43:59.999729 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 30 00:43:59.999729 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 30 00:43:59.999729 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 30 00:43:59.999729 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 30 00:43:59.999729 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 30 00:43:59.999729 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 30 00:43:59.999729 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 30 00:43:59.999729 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 30 00:44:00.000531 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 30 00:44:00.000531 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 00:44:00.000531 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception Oct 30 00:44:00.000531 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 00:44:00.000531 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 00:44:00.000531 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 00:44:00.000531 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 00:44:00.000531 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 00:44:00.000531 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 00:44:00.000531 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 00:44:00.000531 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application conn.query(q) Oct 30 00:44:00.000531 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 00:44:00.000531 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 00:44:00.000531 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 00:44:00.000531 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application result.read() Oct 30 00:44:00.000531 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 00:44:00.000531 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 00:44:00.001581 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 00:44:00.001581 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 00:44:00.001581 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 00:44:00.001581 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 00:44:00.001581 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 00:44:00.001581 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 00:44:00.001581 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 30 00:44:00.001581 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 30 00:44:00.001581 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [parameters: {'id': 'bb2e6baf8c9644a3b09dfd5b3d6c3b84', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 30 00:44:00.001581 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 30 00:44:00.001581 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:44:00.001581 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:44:00.001581 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:44:00.001581 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:00.001581 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 30 00:44:00.002751 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 30 00:44:00.002751 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 30 00:44:00.002751 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 30 00:44:00.002751 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 30 00:44:00.002751 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:44:00.002751 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:44:00.002751 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:44:00.002751 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:00.002751 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:44:00.002751 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:44:00.002751 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:44:00.002751 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:44:00.002751 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:44:00.002751 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:44:00.002751 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:44:00.002751 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:44:00.002751 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:44:00.003970 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:44:00.003970 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 30 00:44:00.003970 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 30 00:44:00.003970 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:44:00.003970 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:44:00.003970 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 30 00:44:00.003970 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 30 00:44:00.003970 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bb2e6baf8c9644a3b09dfd5b3d6c3b84. Oct 30 00:44:00.003970 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:44:00.003970 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 368/744] 10.222.0.40 () {60 vars in 1140 bytes} [Sun Oct 30 00:43:59 2022] POST /identity/v3/projects => generated 262 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:44:00.003970 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcb04b-266a-40ee-82e4-706aa655b3dc None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:00.013735 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:00.108278 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b7dd5-e807-4df8-bf60-6ff27f7eb03b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:00.110795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcb04b-266a-40ee-82e4-706aa655b3dc None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:00.143282 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c208b-12f7-437c-8c41-69f416ea2330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:00.143901 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c208b-12f7-437c-8c41-69f416ea2330 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:00.144178 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c208b-12f7-437c-8c41-69f416ea2330 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:00.144446 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c208b-12f7-437c-8c41-69f416ea2330 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:00.144683 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdb64f-4923-40f4-8621-b211dd1f0951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:00.145015 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c208b-12f7-437c-8c41-69f416ea2330 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:00.145302 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdb64f-4923-40f4-8621-b211dd1f0951 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:00.145575 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdb64f-4923-40f4-8621-b211dd1f0951 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:00.145842 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdb64f-4923-40f4-8621-b211dd1f0951 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:00.146401 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c208b-12f7-437c-8c41-69f416ea2330 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:00.146493 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efdb64f-4923-40f4-8621-b211dd1f0951 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:00.146732 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efdb64f-4923-40f4-8621-b211dd1f0951 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:00.148260 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efdb64f-4923-40f4-8621-b211dd1f0951 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:00.155325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-b06c208b-12f7-437c-8c41-69f416ea2330 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:44:00.155325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:00.155325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:44:00.155325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:44:00.155325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:44:00.155325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:44:00.155325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:44:00.155325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:44:00.155325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:44:00.155325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:44:00.155325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:44:00.155325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:44:00.155325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:00.155325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:44:00.155325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:44:00.155325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:44:00.155325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:44:00.156450 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:44:00.156450 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:44:00.156450 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:44:00.156450 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:44:00.156450 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:44:00.156450 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:44:00.156450 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:44:00.156450 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:44:00.156450 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:44:00.156450 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:44:00.156450 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:44:00.156450 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:44:00.156450 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:44:00.156450 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:44:00.156450 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:44:00.156450 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:44:00.157326 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:44:00.157326 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:44:00.157326 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:44:00.157326 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:44:00.157326 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:44:00.157326 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:44:00.157326 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:44:00.157326 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:44:00.157326 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:44:00.157326 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:44:00.157326 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:44:00.157326 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:44:00.157326 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:44:00.157326 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:44:00.158100 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 369/745] 10.222.0.40 () {56 vars in 1112 bytes} [Sun Oct 30 00:43:59 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:00.158172 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 377/746] 10.222.0.40 () {56 vars in 1126 bytes} [Sun Oct 30 00:43:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:44:00.158239 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdb64f-4923-40f4-8621-b211dd1f0951 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:00.158315 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bbc98-186f-4a1d-b8d3-ba1bfcec4820 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:00.158315 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bbc98-186f-4a1d-b8d3-ba1bfcec4820 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:00.158315 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bbc98-186f-4a1d-b8d3-ba1bfcec4820 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:00.159391 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 378/747] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:44:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:44:00.163975 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bbc98-186f-4a1d-b8d3-ba1bfcec4820 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:00.210484 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:00.231476 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:00.260969 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdb64f-4923-40f4-8621-b211dd1f0951 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:00.265228 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bbc98-186f-4a1d-b8d3-ba1bfcec4820 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:00.294976 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1658c0-2080-4acd-b456-58f63d27e3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:00.295589 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1658c0-2080-4acd-b456-58f63d27e3e1 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:00.295859 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1658c0-2080-4acd-b456-58f63d27e3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:00.296127 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1658c0-2080-4acd-b456-58f63d27e3e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:00.300252 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e1dd5-3182-4e0c-a090-120dfbfe6080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:00.300902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e1dd5-3182-4e0c-a090-120dfbfe6080 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:00.301172 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e1dd5-3182-4e0c-a090-120dfbfe6080 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:00.301492 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e1dd5-3182-4e0c-a090-120dfbfe6080 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:00.302182 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e1dd5-3182-4e0c-a090-120dfbfe6080 None admin] RBAC: Adding query filter params (interface=public, service_id=367a8850887d4606802ab4c825d5156e, region_id=RegionOne) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:00.302454 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1658c0-2080-4acd-b456-58f63d27e3e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:00.302544 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e1dd5-3182-4e0c-a090-120dfbfe6080 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:00.303821 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e1dd5-3182-4e0c-a090-120dfbfe6080 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:00.303906 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1658c0-2080-4acd-b456-58f63d27e3e1 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:00.309338 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 379/748] 10.222.0.40 () {56 vars in 1251 bytes} [Sun Oct 30 00:44:00 2022] GET /identity/v3/endpoints?service_id=367a8850887d4606802ab4c825d5156e&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:00.310484 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c186910-a006-4447-a7d7-cf1f0cea64fb None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:00.310763 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c186910-a006-4447-a7d7-cf1f0cea64fb None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:00.311035 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c186910-a006-4447-a7d7-cf1f0cea64fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:00.316800 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-8a1658c0-2080-4acd-b456-58f63d27e3e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:44:00.316800 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:00.316800 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:44:00.316800 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:44:00.316800 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:44:00.316800 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:44:00.316800 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:44:00.316800 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:44:00.316800 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:44:00.316800 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:44:00.316800 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:44:00.316800 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:44:00.316800 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:44:00.316800 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:44:00.316800 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:44:00.317823 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:44:00.317823 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:44:00.317823 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:44:00.317823 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:44:00.317823 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:44:00.317823 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:44:00.317823 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:44:00.317823 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:44:00.317823 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:44:00.317823 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:44:00.317823 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:44:00.317823 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:44:00.317823 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:44:00.317823 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:44:00.317823 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:44:00.317823 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:44:00.317823 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:44:00.318728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:44:00.318728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:44:00.318728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:44:00.318728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:44:00.318728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:44:00.318728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:44:00.318728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:44:00.318728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:44:00.319157 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 370/749] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:44:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:44:00.319712 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1658c0-2080-4acd-b456-58f63d27e3e1 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:00.329977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-0c186910-a006-4447-a7d7-cf1f0cea64fb None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:44:00.331531 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0c186910-a006-4447-a7d7-cf1f0cea64fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:00.397363 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 380/750] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:44:00 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:44:00.398101 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c186910-a006-4447-a7d7-cf1f0cea64fb None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:00.418164 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1658c0-2080-4acd-b456-58f63d27e3e1 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:00.436645 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:00.448615 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:00.454160 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da460e-16c9-446a-a8e8-4673704d0e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:00.455062 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da460e-16c9-446a-a8e8-4673704d0e6d None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:00.455329 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da460e-16c9-446a-a8e8-4673704d0e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:00.455648 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da460e-16c9-446a-a8e8-4673704d0e6d None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:00.456265 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da460e-16c9-446a-a8e8-4673704d0e6d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:00.456558 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da460e-16c9-446a-a8e8-4673704d0e6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:00.458012 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da460e-16c9-446a-a8e8-4673704d0e6d None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:00.467931 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 371/751] 10.222.0.40 () {56 vars in 1122 bytes} [Sun Oct 30 00:44:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:00.468755 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da460e-16c9-446a-a8e8-4673704d0e6d None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:00.502129 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c186910-a006-4447-a7d7-cf1f0cea64fb None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:00.536780 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4795086-9fbc-4987-88f8-8eaad7346816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:00.537417 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4795086-9fbc-4987-88f8-8eaad7346816 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:00.537694 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4795086-9fbc-4987-88f8-8eaad7346816 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:00.537963 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4795086-9fbc-4987-88f8-8eaad7346816 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:00.538555 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4795086-9fbc-4987-88f8-8eaad7346816 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:00.539904 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4795086-9fbc-4987-88f8-8eaad7346816 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:00.557226 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 381/752] 10.222.0.40 () {56 vars in 1087 bytes} [Sun Oct 30 00:44:00 2022] GET /identity/v3/services => generated 1957 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:44:00.557226 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4795086-9fbc-4987-88f8-8eaad7346816 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:00.587902 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da460e-16c9-446a-a8e8-4673704d0e6d None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:00.640008 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04acd5-9267-438c-baec-148b983ec0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:00.641021 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04acd5-9267-438c-baec-148b983ec0a8 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:00.641388 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04acd5-9267-438c-baec-148b983ec0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:00.641720 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04acd5-9267-438c-baec-148b983ec0a8 None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:00.643168 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04acd5-9267-438c-baec-148b983ec0a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:00.643537 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04acd5-9267-438c-baec-148b983ec0a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:00.645587 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04acd5-9267-438c-baec-148b983ec0a8 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:00.674299 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 372/753] 10.222.0.40 () {56 vars in 1112 bytes} [Sun Oct 30 00:44:00 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:00.675174 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04acd5-9267-438c-baec-148b983ec0a8 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:00.693749 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4795086-9fbc-4987-88f8-8eaad7346816 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:00.695815 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:00.738456 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9224b5b1-2812-4533-8083-c3abe9acab13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:00.739738 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224b5b1-2812-4533-8083-c3abe9acab13 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:00.740171 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224b5b1-2812-4533-8083-c3abe9acab13 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:00.740971 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224b5b1-2812-4533-8083-c3abe9acab13 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:00.742132 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9224b5b1-2812-4533-8083-c3abe9acab13 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:00.742600 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9224b5b1-2812-4533-8083-c3abe9acab13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:00.744845 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9224b5b1-2812-4533-8083-c3abe9acab13 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:00.752919 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 382/754] 10.222.0.40 () {56 vars in 1122 bytes} [Sun Oct 30 00:44:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:00.758969 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:00.759798 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9224b5b1-2812-4533-8083-c3abe9acab13 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:00.819715 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04acd5-9267-438c-baec-148b983ec0a8 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:00.877264 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03769156-2012-4163-986e-4ee5478fc6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:00.878320 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03769156-2012-4163-986e-4ee5478fc6fe None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:00.879335 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03769156-2012-4163-986e-4ee5478fc6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:00.879818 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03769156-2012-4163-986e-4ee5478fc6fe None admin] PATH_INFO: `/v3/services/image` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:00.880877 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03769156-2012-4163-986e-4ee5478fc6fe None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:00.885368 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03769156-2012-4163-986e-4ee5478fc6fe None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:00.892105 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9224b5b1-2812-4533-8083-c3abe9acab13 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:00.897026 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-03769156-2012-4163-986e-4ee5478fc6fe None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 30 00:44:00.897026 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:00.897026 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:44:00.897026 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:44:00.897026 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:44:00.897026 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:44:00.897026 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:44:00.897026 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:44:00.897026 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 30 00:44:00.897026 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:44:00.897026 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:44:00.897026 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:44:00.897026 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:00.897026 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:44:00.897026 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:44:00.897026 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:44:00.897026 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:44:00.898067 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:44:00.898067 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:44:00.898067 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:44:00.898067 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:44:00.898067 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:44:00.898067 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:44:00.898067 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:44:00.898067 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:44:00.898067 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:44:00.898067 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:44:00.898067 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:44:00.898067 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:44:00.898067 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:44:00.898067 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:44:00.898067 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:44:00.898067 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:44:00.898922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:44:00.898922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:44:00.898922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:44:00.898922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:44:00.898922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:44:00.898922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:44:00.898922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:44:00.898922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:44:00.898922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:44:00.898922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:44:00.898922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:44:00.898922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:44:00.898922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 30 00:44:00.898922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:44:00.898922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 373/755] 10.222.0.40 () {56 vars in 1105 bytes} [Sun Oct 30 00:44:00 2022] GET /identity/v3/services/image => generated 86 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:44:00.907774 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03769156-2012-4163-986e-4ee5478fc6fe None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:00.934099 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98513b92-ebae-4afd-851c-44a31330c0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:00.934639 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98513b92-ebae-4afd-851c-44a31330c0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:00.934915 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98513b92-ebae-4afd-851c-44a31330c0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:00.935183 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98513b92-ebae-4afd-851c-44a31330c0e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:00.935882 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98513b92-ebae-4afd-851c-44a31330c0e7 None admin] RBAC: Adding query filter params (interface=admin, service_id=465a4ae202bf4332bf98b2c81d2c598d, region_id=RegionOne) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:00.936185 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98513b92-ebae-4afd-851c-44a31330c0e7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:00.937563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98513b92-ebae-4afd-851c-44a31330c0e7 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:00.943098 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 383/756] 10.222.0.40 () {56 vars in 1249 bytes} [Sun Oct 30 00:44:00 2022] GET /identity/v3/endpoints?service_id=465a4ae202bf4332bf98b2c81d2c598d&interface=admin®ion_id=RegionOne => generated 193 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:00.948596 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98513b92-ebae-4afd-851c-44a31330c0e7 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:00.993080 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:01.022578 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03769156-2012-4163-986e-4ee5478fc6fe None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:01.045786 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:01.066739 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbb91f-1726-4fe3-a9da-6ec50095cffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:01.067346 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbb91f-1726-4fe3-a9da-6ec50095cffa None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:01.067622 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbb91f-1726-4fe3-a9da-6ec50095cffa None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:01.067897 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbb91f-1726-4fe3-a9da-6ec50095cffa None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:01.068590 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbb91f-1726-4fe3-a9da-6ec50095cffa None admin] RBAC: Adding query filter params (name=image) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:01.068899 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbb91f-1726-4fe3-a9da-6ec50095cffa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:01.070844 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbb91f-1726-4fe3-a9da-6ec50095cffa None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:01.078384 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 374/757] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:44:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:44:01.084190 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbb91f-1726-4fe3-a9da-6ec50095cffa None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:01.085778 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98513b92-ebae-4afd-851c-44a31330c0e7 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:01.125074 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0c519-1b76-4528-b199-0d8a14ec0929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:01.126106 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0c519-1b76-4528-b199-0d8a14ec0929 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:01.126635 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0c519-1b76-4528-b199-0d8a14ec0929 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:01.127315 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0c519-1b76-4528-b199-0d8a14ec0929 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:01.128931 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0c519-1b76-4528-b199-0d8a14ec0929 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:01.130594 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0c519-1b76-4528-b199-0d8a14ec0929 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:01.140227 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 384/758] 10.222.0.40 () {56 vars in 1087 bytes} [Sun Oct 30 00:44:00 2022] GET /identity/v3/services => generated 1957 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:44:01.208906 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbb91f-1726-4fe3-a9da-6ec50095cffa None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:01.246239 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79890d-6cb5-48d7-b2af-d412bc6da1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:01.246847 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79890d-6cb5-48d7-b2af-d412bc6da1a0 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:01.247121 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79890d-6cb5-48d7-b2af-d412bc6da1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:01.247387 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79890d-6cb5-48d7-b2af-d412bc6da1a0 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:01.248020 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79890d-6cb5-48d7-b2af-d412bc6da1a0 None admin] RBAC: Adding query filter params (type=image) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:01.248313 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79890d-6cb5-48d7-b2af-d412bc6da1a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:01.249745 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79890d-6cb5-48d7-b2af-d412bc6da1a0 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:01.255847 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 375/759] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:44:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:01.262108 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0c519-1b76-4528-b199-0d8a14ec0929 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:01.374253 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:01.387554 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0c519-1b76-4528-b199-0d8a14ec0929 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:01.424018 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbba6e-e09c-49bb-b412-3599ce2b47e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:01.424830 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbba6e-e09c-49bb-b412-3599ce2b47e2 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:01.425102 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbba6e-e09c-49bb-b412-3599ce2b47e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:01.425394 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbba6e-e09c-49bb-b412-3599ce2b47e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:01.426080 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcbba6e-e09c-49bb-b412-3599ce2b47e2 None admin] RBAC: Adding query filter params (interface=public, service_id=8169396a20c64fc0b950529befa267f2, region_id=RegionOne) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:01.426378 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcbba6e-e09c-49bb-b412-3599ce2b47e2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:01.427723 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcbba6e-e09c-49bb-b412-3599ce2b47e2 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:01.433346 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 385/760] 10.222.0.40 () {56 vars in 1251 bytes} [Sun Oct 30 00:44:01 2022] GET /identity/v3/endpoints?service_id=8169396a20c64fc0b950529befa267f2&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:01.438831 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79890d-6cb5-48d7-b2af-d412bc6da1a0 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:01.492369 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:01.547475 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79890d-6cb5-48d7-b2af-d412bc6da1a0 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:01.581850 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07bc9e-aaa7-43d3-bbb7-bcbe86232b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:01.582454 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07bc9e-aaa7-43d3-bbb7-bcbe86232b43 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:01.582731 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07bc9e-aaa7-43d3-bbb7-bcbe86232b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:01.582998 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07bc9e-aaa7-43d3-bbb7-bcbe86232b43 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:01.583597 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07bc9e-aaa7-43d3-bbb7-bcbe86232b43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:01.584948 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07bc9e-aaa7-43d3-bbb7-bcbe86232b43 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:01.592387 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 376/761] 10.222.0.40 () {56 vars in 1087 bytes} [Sun Oct 30 00:44:01 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:44:02.785118 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68938fd9-1a04-4f7e-97c4-5c674b3ca68d None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:02.785647 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68938fd9-1a04-4f7e-97c4-5c674b3ca68d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:02.785722 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68938fd9-1a04-4f7e-97c4-5c674b3ca68d None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:02.787264 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 386/762] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:44:02.793402 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735137a-5096-4fd6-ba98-4c8bbf5e95fc None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:02.793825 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735137a-5096-4fd6-ba98-4c8bbf5e95fc None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:02.794008 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735137a-5096-4fd6-ba98-4c8bbf5e95fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:02.812846 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-a735137a-5096-4fd6-ba98-4c8bbf5e95fc None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:44:02.814375 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a735137a-5096-4fd6-ba98-4c8bbf5e95fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:02.881767 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 377/763] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:44:02 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:44:03.042427 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b1dc5-4376-49fd-abe9-016b5c21e9aa None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:03.043125 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b1dc5-4376-49fd-abe9-016b5c21e9aa None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:03.043606 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b1dc5-4376-49fd-abe9-016b5c21e9aa None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:03.045411 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 387/764] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:44:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:44:03.050710 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411eecb8-ec39-436c-9eac-a26894dcc9b9 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:03.051203 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411eecb8-ec39-436c-9eac-a26894dcc9b9 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:03.051682 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411eecb8-ec39-436c-9eac-a26894dcc9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:03.070859 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-411eecb8-ec39-436c-9eac-a26894dcc9b9 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:44:03.072305 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-411eecb8-ec39-436c-9eac-a26894dcc9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:03.108734 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:03.143752 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 378/765] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:44:03 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:44:03.151077 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b1dc5-4376-49fd-abe9-016b5c21e9aa None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:03.260709 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b1dc5-4376-49fd-abe9-016b5c21e9aa None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:03.300269 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a1dd5-c9f4-419a-bf60-9c0a95bb7c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:03.301179 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a1dd5-c9f4-419a-bf60-9c0a95bb7c8d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:03.301645 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a1dd5-c9f4-419a-bf60-9c0a95bb7c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:03.302089 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a1dd5-c9f4-419a-bf60-9c0a95bb7c8d None admin] PATH_INFO: `/v3/services/compute` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:03.302840 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a1dd5-c9f4-419a-bf60-9c0a95bb7c8d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:03.304405 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a1dd5-c9f4-419a-bf60-9c0a95bb7c8d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:03.315147 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-e56a1dd5-c9f4-419a-bf60-9c0a95bb7c8d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 30 00:44:03.315147 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:03.315147 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:44:03.315147 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:44:03.315147 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:44:03.315147 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:44:03.315147 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:44:03.315147 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:44:03.315147 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 30 00:44:03.315147 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:44:03.315147 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:44:03.315147 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:44:03.315147 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:03.315147 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:44:03.315147 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:44:03.315147 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:44:03.315147 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:44:03.316458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:44:03.316458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:44:03.316458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:44:03.316458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:44:03.316458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:44:03.316458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:44:03.316458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:44:03.316458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:44:03.316458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:44:03.316458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:44:03.316458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:44:03.316458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:44:03.316458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:44:03.316458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:44:03.316458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:44:03.316458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:44:03.317559 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:44:03.317559 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:44:03.317559 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:44:03.317559 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:44:03.317559 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:44:03.317559 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:44:03.317559 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:44:03.317559 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:44:03.317559 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:44:03.317559 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:44:03.317559 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:44:03.317559 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:44:03.317559 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 30 00:44:03.317559 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:44:03.320009 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 388/766] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:44:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:44:03.328573 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411eecb8-ec39-436c-9eac-a26894dcc9b9 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:03.420607 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a1dd5-c9f4-419a-bf60-9c0a95bb7c8d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:03.429442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411eecb8-ec39-436c-9eac-a26894dcc9b9 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:03.446676 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:03.465683 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b72af4-868c-426b-b2d9-12e6b4adaaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:03.466565 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b72af4-868c-426b-b2d9-12e6b4adaaff None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:03.466565 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b72af4-868c-426b-b2d9-12e6b4adaaff None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:03.466846 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b72af4-868c-426b-b2d9-12e6b4adaaff None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:03.467440 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b72af4-868c-426b-b2d9-12e6b4adaaff None admin] RBAC: Adding query filter params (name=compute) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:03.467892 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b72af4-868c-426b-b2d9-12e6b4adaaff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:03.469145 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b72af4-868c-426b-b2d9-12e6b4adaaff None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:03.478571 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 379/767] 10.222.0.40 () {56 vars in 1112 bytes} [Sun Oct 30 00:44:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:03.478571 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7aa5df-981f-441a-b5ea-41c8e751cc7a None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:03.478571 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7aa5df-981f-441a-b5ea-41c8e751cc7a None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:03.478571 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7aa5df-981f-441a-b5ea-41c8e751cc7a None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:03.478571 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 380/768] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:44:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:44:03.480512 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7aa5df-981f-441a-b5ea-41c8e751cc7a None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:03.519134 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:03.534323 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a1dd5-c9f4-419a-bf60-9c0a95bb7c8d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:03.570671 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22654229-b5f1-45ac-8d43-dac916d8d98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:03.571191 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22654229-b5f1-45ac-8d43-dac916d8d98c None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:03.571478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22654229-b5f1-45ac-8d43-dac916d8d98c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:03.571750 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22654229-b5f1-45ac-8d43-dac916d8d98c None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:03.572394 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22654229-b5f1-45ac-8d43-dac916d8d98c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:03.573897 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22654229-b5f1-45ac-8d43-dac916d8d98c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:03.576535 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: WARNING keystone.server.flask.common [None req-22654229-b5f1-45ac-8d43-dac916d8d98c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 30 00:44:03.588896 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7aa5df-981f-441a-b5ea-41c8e751cc7a None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:03.590165 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.sql.core [None req-22654229-b5f1-45ac-8d43-dac916d8d98c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 30 00:44:03.590165 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 30 00:44:03.590165 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [parameters: {'user_id': 'da02e32ebef1468b97cb01a6f94d6daf', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 30 00:44:03.590165 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81351) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 30 00:44:03.598020 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-22654229-b5f1-45ac-8d43-dac916d8d98c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 30 00:44:03.598020 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:03.598020 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 00:44:03.598020 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 00:44:03.598020 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 00:44:03.598020 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 00:44:03.598020 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 00:44:03.598020 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 00:44:03.598020 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 00:44:03.598020 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application conn.query(q) Oct 30 00:44:03.598020 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 00:44:03.598020 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 00:44:03.598020 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 00:44:03.598020 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application result.read() Oct 30 00:44:03.598020 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 00:44:03.598910 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 00:44:03.598910 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 00:44:03.598910 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 00:44:03.598910 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 00:44:03.598910 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 00:44:03.598910 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 00:44:03.598910 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 00:44:03.598910 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 30 00:44:03.598910 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:44:03.598910 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 30 00:44:03.598910 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:44:03.598910 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:03.598910 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 30 00:44:03.598910 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 30 00:44:03.598910 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 30 00:44:03.598910 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 30 00:44:03.598910 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 00:44:03.598910 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application next(self.gen) Oct 30 00:44:03.599847 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 30 00:44:03.599847 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application yield resource Oct 30 00:44:03.599847 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 00:44:03.599847 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application next(self.gen) Oct 30 00:44:03.599847 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 30 00:44:03.599847 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.session.rollback() Oct 30 00:44:03.599847 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 00:44:03.599847 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.force_reraise() Oct 30 00:44:03.599847 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 00:44:03.599847 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise self.value Oct 30 00:44:03.599847 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 30 00:44:03.599847 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 30 00:44:03.599847 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 30 00:44:03.599847 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application session.commit() Oct 30 00:44:03.599847 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 30 00:44:03.599847 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 30 00:44:03.599847 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 30 00:44:03.600749 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._prepare_impl() Oct 30 00:44:03.600749 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 30 00:44:03.600749 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.session.flush() Oct 30 00:44:03.600749 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 30 00:44:03.600749 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._flush(objects) Oct 30 00:44:03.600749 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 30 00:44:03.600749 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 30 00:44:03.600749 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 30 00:44:03.600749 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application compat.raise_( Oct 30 00:44:03.600749 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 00:44:03.600749 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception Oct 30 00:44:03.600749 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 30 00:44:03.600749 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application flush_context.execute() Oct 30 00:44:03.600749 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 30 00:44:03.600749 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rec.execute(self) Oct 30 00:44:03.600749 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 30 00:44:03.600749 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 30 00:44:03.602324 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 30 00:44:03.602324 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 30 00:44:03.602324 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 30 00:44:03.602324 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 30 00:44:03.602324 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 30 00:44:03.602324 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 30 00:44:03.602324 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 30 00:44:03.602324 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 30 00:44:03.602324 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 30 00:44:03.602324 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 30 00:44:03.602324 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 30 00:44:03.602324 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 30 00:44:03.602324 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 30 00:44:03.602324 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 30 00:44:03.602324 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 00:44:03.602324 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception Oct 30 00:44:03.603152 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 00:44:03.603152 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 00:44:03.603152 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 00:44:03.603152 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 00:44:03.603152 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 00:44:03.603152 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 00:44:03.603152 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 00:44:03.603152 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application conn.query(q) Oct 30 00:44:03.603152 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 00:44:03.603152 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 00:44:03.603152 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 00:44:03.603152 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application result.read() Oct 30 00:44:03.603152 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 00:44:03.603152 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 00:44:03.603152 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 00:44:03.603152 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 00:44:03.605331 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 00:44:03.605331 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 00:44:03.605331 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 00:44:03.605331 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 00:44:03.605331 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 30 00:44:03.605331 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 30 00:44:03.605331 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [parameters: {'user_id': 'da02e32ebef1468b97cb01a6f94d6daf', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 30 00:44:03.605331 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 30 00:44:03.605331 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:44:03.605331 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:44:03.605331 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:44:03.605331 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:03.605331 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:44:03.605331 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:44:03.605331 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:44:03.606471 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:44:03.606471 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:44:03.606471 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:44:03.606471 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:44:03.606471 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:44:03.606471 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:44:03.606471 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:44:03.606471 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 30 00:44:03.606471 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 30 00:44:03.606471 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:44:03.606471 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:44:03.606471 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:44:03.606471 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:44:03.606471 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:44:03.606471 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:44:03.606471 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 30 00:44:03.606471 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 30 00:44:03.609145 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 30 00:44:03.609145 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 30 00:44:03.609145 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 30 00:44:03.609145 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 30 00:44:03.609145 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 30 00:44:03.609145 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:44:03.609145 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 389/769] 10.222.0.40 () {60 vars in 1131 bytes} [Sun Oct 30 00:44:03 2022] POST /identity/v3/users => generated 160 bytes in 179 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:44:03.609145 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca8ac8-6963-4362-beac-6d2345f17d56 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:03.609145 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca8ac8-6963-4362-beac-6d2345f17d56 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:03.609145 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca8ac8-6963-4362-beac-6d2345f17d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:03.621848 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-78ca8ac8-6963-4362-beac-6d2345f17d56 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:44:03.623361 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-78ca8ac8-6963-4362-beac-6d2345f17d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:03.635973 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bef29c-e476-43a1-81b0-fca269dc3284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:03.636596 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bef29c-e476-43a1-81b0-fca269dc3284 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:03.636910 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bef29c-e476-43a1-81b0-fca269dc3284 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:03.637180 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bef29c-e476-43a1-81b0-fca269dc3284 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:03.638024 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bef29c-e476-43a1-81b0-fca269dc3284 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:03.638317 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bef29c-e476-43a1-81b0-fca269dc3284 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:03.640051 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bef29c-e476-43a1-81b0-fca269dc3284 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:03.644980 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 381/770] 10.222.0.40 () {56 vars in 1112 bytes} [Sun Oct 30 00:44:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:03.644980 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bef29c-e476-43a1-81b0-fca269dc3284 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:03.713224 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 390/771] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:44:03 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:44:03.713224 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca8ac8-6963-4362-beac-6d2345f17d56 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:03.723250 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:03.790521 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:03.794573 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bef29c-e476-43a1-81b0-fca269dc3284 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:03.828167 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca8ac8-6963-4362-beac-6d2345f17d56 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:03.832870 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd049336-f101-44c8-ac44-8758fad30985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:03.833526 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd049336-f101-44c8-ac44-8758fad30985 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:03.833802 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd049336-f101-44c8-ac44-8758fad30985 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:03.834072 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd049336-f101-44c8-ac44-8758fad30985 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:03.841713 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd049336-f101-44c8-ac44-8758fad30985 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:03.843157 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd049336-f101-44c8-ac44-8758fad30985 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:03.855769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-cd049336-f101-44c8-ac44-8758fad30985 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 30 00:44:03.855769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:03.855769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:44:03.855769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:44:03.855769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:44:03.855769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:44:03.855769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:44:03.855769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:44:03.855769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:44:03.855769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:44:03.855769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:44:03.855769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:44:03.855769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:44:03.855769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:44:03.855769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:44:03.855769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:44:03.856822 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:44:03.856822 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:44:03.856822 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:44:03.856822 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:44:03.856822 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:44:03.856822 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:44:03.856822 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:44:03.856822 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:44:03.856822 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:44:03.856822 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:44:03.856822 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:44:03.856822 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:44:03.856822 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:44:03.856822 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:44:03.856822 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:44:03.856822 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:44:03.856822 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:44:03.856822 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:44:03.858013 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:44:03.858013 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:44:03.858013 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:44:03.858013 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:44:03.858013 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:44:03.858013 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:44:03.858013 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:44:03.858013 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:44:03.858013 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 30 00:44:03.858013 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:44:03.858013 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 382/772] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:44:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:44:03.858013 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7bc47-f977-40ce-9ca3-5c5362472e2e None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:03.858811 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7bc47-f977-40ce-9ca3-5c5362472e2e None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:03.858811 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7bc47-f977-40ce-9ca3-5c5362472e2e None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:03.865211 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 383/773] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:44:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:44:03.865211 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7bc47-f977-40ce-9ca3-5c5362472e2e None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:03.869174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b007dc-d073-4b9c-84b3-04ab6ea84f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:03.869804 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b007dc-d073-4b9c-84b3-04ab6ea84f34 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:03.870082 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b007dc-d073-4b9c-84b3-04ab6ea84f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:03.870386 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b007dc-d073-4b9c-84b3-04ab6ea84f34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:03.871042 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b007dc-d073-4b9c-84b3-04ab6ea84f34 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:03.872602 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b007dc-d073-4b9c-84b3-04ab6ea84f34 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:03.897243 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 391/774] 10.222.0.40 () {60 vars in 1144 bytes} [Sun Oct 30 00:44:03 2022] POST /identity/v3/endpoints => generated 334 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:44:03.897864 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19654474-71ca-4871-ae08-da328bc8cc48 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:03.898142 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19654474-71ca-4871-ae08-da328bc8cc48 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:03.898415 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19654474-71ca-4871-ae08-da328bc8cc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:03.930031 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-19654474-71ca-4871-ae08-da328bc8cc48 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:44:03.932085 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-19654474-71ca-4871-ae08-da328bc8cc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:04.010228 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7bc47-f977-40ce-9ca3-5c5362472e2e None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:04.017684 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:04.023970 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 392/775] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:44:03 2022] POST /identity/v3/auth/tokens => generated 1822 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:44:04.025267 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19654474-71ca-4871-ae08-da328bc8cc48 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:04.055370 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaca2d7-1e37-4e04-9d4e-868d909a1c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:04.055985 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaca2d7-1e37-4e04-9d4e-868d909a1c1e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:04.056283 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaca2d7-1e37-4e04-9d4e-868d909a1c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:04.056552 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaca2d7-1e37-4e04-9d4e-868d909a1c1e None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:04.057272 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaca2d7-1e37-4e04-9d4e-868d909a1c1e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:04.057570 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaca2d7-1e37-4e04-9d4e-868d909a1c1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:04.059079 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaca2d7-1e37-4e04-9d4e-868d909a1c1e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:04.103621 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 384/776] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Oct 30 00:44:03 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:04.169646 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19654474-71ca-4871-ae08-da328bc8cc48 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:04.211596 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cd747-80c1-4fa2-a5cc-22c670bbb7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:04.212234 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cd747-80c1-4fa2-a5cc-22c670bbb7eb None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:04.212506 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cd747-80c1-4fa2-a5cc-22c670bbb7eb None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:04.212771 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cd747-80c1-4fa2-a5cc-22c670bbb7eb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:04.213405 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117cd747-80c1-4fa2-a5cc-22c670bbb7eb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:04.215347 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117cd747-80c1-4fa2-a5cc-22c670bbb7eb None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:04.224929 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-117cd747-80c1-4fa2-a5cc-22c670bbb7eb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:44:04.224929 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:04.224929 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:44:04.224929 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:44:04.224929 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:44:04.224929 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:44:04.224929 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:44:04.224929 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:44:04.224929 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:44:04.224929 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:44:04.224929 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:44:04.224929 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:44:04.224929 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:04.224929 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:44:04.224929 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:44:04.224929 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:44:04.224929 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:44:04.226005 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:44:04.226005 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:44:04.226005 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:44:04.226005 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:44:04.226005 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:44:04.226005 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:44:04.226005 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:44:04.226005 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:44:04.226005 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:44:04.226005 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:44:04.226005 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:44:04.226005 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:44:04.226005 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:44:04.226005 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:44:04.226005 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:44:04.226005 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:44:04.227055 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:44:04.227055 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:44:04.227055 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:44:04.227055 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:44:04.227055 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:44:04.227055 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:44:04.227055 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:44:04.227055 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:44:04.227055 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:44:04.227055 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:44:04.227055 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:44:04.227055 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:44:04.227055 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:44:04.227055 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:44:04.227055 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 393/777] 10.222.0.40 () {56 vars in 1126 bytes} [Sun Oct 30 00:44:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:44:04.232689 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaca2d7-1e37-4e04-9d4e-868d909a1c1e None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:04.250693 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:04.299764 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cd747-80c1-4fa2-a5cc-22c670bbb7eb None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:04.353429 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaca2d7-1e37-4e04-9d4e-868d909a1c1e None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:04.376095 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:04.403725 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39631d-800f-4268-ae3b-b1ae8de9643f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:04.404702 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39631d-800f-4268-ae3b-b1ae8de9643f None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:04.405177 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39631d-800f-4268-ae3b-b1ae8de9643f None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:04.405714 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39631d-800f-4268-ae3b-b1ae8de9643f None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:04.406653 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c39631d-800f-4268-ae3b-b1ae8de9643f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:04.407287 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c39631d-800f-4268-ae3b-b1ae8de9643f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:04.408763 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c39631d-800f-4268-ae3b-b1ae8de9643f None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:04.414751 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 385/778] 10.222.0.40 () {56 vars in 1122 bytes} [Sun Oct 30 00:44:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:04.420593 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39631d-800f-4268-ae3b-b1ae8de9643f None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:04.424314 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cd747-80c1-4fa2-a5cc-22c670bbb7eb None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:04.462498 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4fff9c-91c9-4622-957d-820015807660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:04.463255 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fff9c-91c9-4622-957d-820015807660 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:04.463531 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fff9c-91c9-4622-957d-820015807660 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:04.463800 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fff9c-91c9-4622-957d-820015807660 None admin] PATH_INFO: `/v3/services/image` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:04.464950 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4fff9c-91c9-4622-957d-820015807660 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:04.466418 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4fff9c-91c9-4622-957d-820015807660 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:04.475433 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-be4fff9c-91c9-4622-957d-820015807660 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 30 00:44:04.475433 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:04.475433 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:44:04.475433 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:44:04.475433 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:44:04.475433 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:44:04.475433 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:44:04.475433 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:44:04.475433 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 30 00:44:04.475433 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:44:04.475433 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:44:04.475433 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:44:04.475433 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:04.475433 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:44:04.475433 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:44:04.475433 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:44:04.475433 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:44:04.476424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:44:04.476424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:44:04.476424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:44:04.476424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:44:04.476424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:44:04.476424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:44:04.476424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:44:04.476424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:44:04.476424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:44:04.476424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:44:04.476424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:44:04.476424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:44:04.476424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:44:04.476424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:44:04.476424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:44:04.476424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:44:04.478174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:44:04.478174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:44:04.478174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:44:04.478174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:44:04.478174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:44:04.478174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:44:04.478174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:44:04.478174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:44:04.478174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:44:04.478174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:44:04.478174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:44:04.478174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:44:04.478174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 30 00:44:04.478174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:44:04.478174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 394/779] 10.222.0.40 () {56 vars in 1105 bytes} [Sun Oct 30 00:44:04 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:44:04.482333 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4fff9c-91c9-4622-957d-820015807660 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:04.516278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:04.540813 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39631d-800f-4268-ae3b-b1ae8de9643f None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:04.582750 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2443e4a-933a-4eb7-887e-704f607c12f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:04.583753 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2443e4a-933a-4eb7-887e-704f607c12f4 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:04.584294 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2443e4a-933a-4eb7-887e-704f607c12f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:04.584573 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2443e4a-933a-4eb7-887e-704f607c12f4 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:04.585209 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2443e4a-933a-4eb7-887e-704f607c12f4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:04.585533 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2443e4a-933a-4eb7-887e-704f607c12f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:04.586009 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4fff9c-91c9-4622-957d-820015807660 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:04.586893 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2443e4a-933a-4eb7-887e-704f607c12f4 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:04.596697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 386/780] 10.222.0.40 () {56 vars in 1122 bytes} [Sun Oct 30 00:44:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:44:04.599070 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2443e4a-933a-4eb7-887e-704f607c12f4 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:04.616894 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:04.625946 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98e63d-d5b4-4b6a-8e46-482d284da5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:04.626594 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98e63d-d5b4-4b6a-8e46-482d284da5a0 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:04.626814 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98e63d-d5b4-4b6a-8e46-482d284da5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:04.627083 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98e63d-d5b4-4b6a-8e46-482d284da5a0 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:04.627704 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98e63d-d5b4-4b6a-8e46-482d284da5a0 None admin] RBAC: Adding query filter params (name=image) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:04.627995 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98e63d-d5b4-4b6a-8e46-482d284da5a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:04.629381 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98e63d-d5b4-4b6a-8e46-482d284da5a0 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:04.634347 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 395/781] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:44:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:44:04.640456 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98e63d-d5b4-4b6a-8e46-482d284da5a0 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:04.717866 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2443e4a-933a-4eb7-887e-704f607c12f4 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:04.748125 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98e63d-d5b4-4b6a-8e46-482d284da5a0 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:04.753356 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e87c5a-50ec-48eb-b38f-eeb413f6b1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:04.754032 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e87c5a-50ec-48eb-b38f-eeb413f6b1f9 None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:04.754401 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e87c5a-50ec-48eb-b38f-eeb413f6b1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:04.754743 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e87c5a-50ec-48eb-b38f-eeb413f6b1f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:04.755466 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e87c5a-50ec-48eb-b38f-eeb413f6b1f9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:04.756841 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e87c5a-50ec-48eb-b38f-eeb413f6b1f9 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:04.775491 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 387/782] 10.222.0.40 () {60 vars in 1144 bytes} [Sun Oct 30 00:44:04 2022] POST /identity/v3/endpoints => generated 325 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:44:04.794738 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8db15-5e10-4ab7-8720-bfdcca9a0e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:04.795354 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8db15-5e10-4ab7-8720-bfdcca9a0e66 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:04.795631 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8db15-5e10-4ab7-8720-bfdcca9a0e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:04.795895 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8db15-5e10-4ab7-8720-bfdcca9a0e66 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:04.796526 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c8db15-5e10-4ab7-8720-bfdcca9a0e66 None admin] RBAC: Adding query filter params (type=image) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:04.796841 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c8db15-5e10-4ab7-8720-bfdcca9a0e66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:04.798274 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c8db15-5e10-4ab7-8720-bfdcca9a0e66 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:04.809668 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 396/783] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:44:04 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:04.810551 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e87c5a-50ec-48eb-b38f-eeb413f6b1f9 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:04.813893 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:04.924716 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e87c5a-50ec-48eb-b38f-eeb413f6b1f9 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:04.961113 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2e50a-28e5-4b91-aabc-772212110052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:04.961755 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2e50a-28e5-4b91-aabc-772212110052 None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:04.962025 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2e50a-28e5-4b91-aabc-772212110052 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:04.962287 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2e50a-28e5-4b91-aabc-772212110052 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:04.963016 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e2e50a-28e5-4b91-aabc-772212110052 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:04.964379 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e2e50a-28e5-4b91-aabc-772212110052 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:04.986107 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 388/784] 10.222.0.40 () {60 vars in 1144 bytes} [Sun Oct 30 00:44:04 2022] POST /identity/v3/endpoints => generated 327 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:44:06.235908 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2163e-26e1-4213-94f1-b9fcc0749f37 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:06.236428 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2163e-26e1-4213-94f1-b9fcc0749f37 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:06.236428 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2163e-26e1-4213-94f1-b9fcc0749f37 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:06.237983 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 397/785] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:44:06.243199 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d0acb-4383-444c-8dd6-f4cbd6801947 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:06.243590 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d0acb-4383-444c-8dd6-f4cbd6801947 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:06.243797 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d0acb-4383-444c-8dd6-f4cbd6801947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:06.262207 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-405d0acb-4383-444c-8dd6-f4cbd6801947 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:44:06.263502 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-405d0acb-4383-444c-8dd6-f4cbd6801947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:06.317498 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:06.339034 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 389/786] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:44:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:44:06.608486 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2163e-26e1-4213-94f1-b9fcc0749f37 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:06.664469 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:06.715346 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2163e-26e1-4213-94f1-b9fcc0749f37 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:06.748879 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83d67b-659e-4464-94b3-64b4f49fda96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:06.749522 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83d67b-659e-4464-94b3-64b4f49fda96 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:06.749795 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83d67b-659e-4464-94b3-64b4f49fda96 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:06.750060 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83d67b-659e-4464-94b3-64b4f49fda96 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:06.760406 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83d67b-659e-4464-94b3-64b4f49fda96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:44:06.765202 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-dd83d67b-659e-4464-94b3-64b4f49fda96 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 30 00:44:06.765202 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:06.765202 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:44:06.765202 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:44:06.765202 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:44:06.765202 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:44:06.765202 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:44:06.765202 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:44:06.765202 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:44:06.765202 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:44:06.765202 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:44:06.765202 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:44:06.765202 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:44:06.765202 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:44:06.765202 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:44:06.765202 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:44:06.766194 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:44:06.766194 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:44:06.766194 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:44:06.766194 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:44:06.766194 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:44:06.766194 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:44:06.766194 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:44:06.766194 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:44:06.766194 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:44:06.766194 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:44:06.766194 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:44:06.766194 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:44:06.766194 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:44:06.766194 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:44:06.766194 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:44:06.766194 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:44:06.767106 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:44:06.767106 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:44:06.767106 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:44:06.767106 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:44:06.767106 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:44:06.767106 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:44:06.767106 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:44:06.767106 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:44:06.767106 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:44:06.767106 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:44:06.767106 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 30 00:44:06.767106 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:44:06.767106 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 398/787] 10.222.0.40 () {56 vars in 1120 bytes} [Sun Oct 30 00:44:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:44:06.772305 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d0acb-4383-444c-8dd6-f4cbd6801947 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:06.875902 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d0acb-4383-444c-8dd6-f4cbd6801947 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:06.909262 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d016e2e-5f0d-4f3c-8e7e-2046f5eb233b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:06.909854 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d016e2e-5f0d-4f3c-8e7e-2046f5eb233b None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:06.910126 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d016e2e-5f0d-4f3c-8e7e-2046f5eb233b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:06.910391 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d016e2e-5f0d-4f3c-8e7e-2046f5eb233b None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:06.911038 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d016e2e-5f0d-4f3c-8e7e-2046f5eb233b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:06.911329 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d016e2e-5f0d-4f3c-8e7e-2046f5eb233b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:06.912674 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d016e2e-5f0d-4f3c-8e7e-2046f5eb233b None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:06.921428 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 390/788] 10.222.0.40 () {56 vars in 1115 bytes} [Sun Oct 30 00:44:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:06.927004 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83d67b-659e-4464-94b3-64b4f49fda96 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:06.955468 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fd059-b354-41b1-a28d-799ad27de391 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:06.955778 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fd059-b354-41b1-a28d-799ad27de391 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:06.956015 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fd059-b354-41b1-a28d-799ad27de391 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:06.957500 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 391/789] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:44:06.962151 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f686276-df2e-47a0-b0b5-28ff328e1aac None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:06.962433 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f686276-df2e-47a0-b0b5-28ff328e1aac None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:06.962703 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f686276-df2e-47a0-b0b5-28ff328e1aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:06.980896 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-2f686276-df2e-47a0-b0b5-28ff328e1aac None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:44:06.982131 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-2f686276-df2e-47a0-b0b5-28ff328e1aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:07.025538 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:07.029596 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83d67b-659e-4464-94b3-64b4f49fda96 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:07.043742 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:07.057368 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 392/790] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:44:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:44:07.069322 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea1cbe-aba3-4e6c-ad1c-b418a0bad411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:07.069948 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea1cbe-aba3-4e6c-ad1c-b418a0bad411 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:07.070222 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea1cbe-aba3-4e6c-ad1c-b418a0bad411 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:07.070490 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea1cbe-aba3-4e6c-ad1c-b418a0bad411 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:07.082783 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea1cbe-aba3-4e6c-ad1c-b418a0bad411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:07.084289 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea1cbe-aba3-4e6c-ad1c-b418a0bad411 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:07.100455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-0dea1cbe-aba3-4e6c-ad1c-b418a0bad411 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:44:07.100455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:07.100455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:44:07.100455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:44:07.100455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:44:07.100455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:44:07.100455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:44:07.100455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:44:07.100455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:44:07.100455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:44:07.100455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:44:07.100455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:44:07.100455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:44:07.100455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:44:07.100455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:44:07.100455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:44:07.101538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:44:07.101538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:44:07.101538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:44:07.101538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:44:07.101538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:44:07.101538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:44:07.101538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:44:07.101538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:44:07.101538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:44:07.101538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:44:07.101538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:44:07.101538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:44:07.101538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:44:07.101538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:44:07.101538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:44:07.101538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:44:07.101538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:44:07.107904 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:44:07.107904 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:44:07.107904 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:44:07.107904 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 399/791] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:44:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:44:07.109793 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f686276-df2e-47a0-b0b5-28ff328e1aac None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:07.199278 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bd148-dcdf-49cf-a552-0e084baa480c None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:07.199557 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bd148-dcdf-49cf-a552-0e084baa480c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:07.199892 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bd148-dcdf-49cf-a552-0e084baa480c None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:07.201467 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 400/792] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:44:07.206146 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02f7fa-6607-4c01-9774-5b15b2c01074 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:07.206426 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02f7fa-6607-4c01-9774-5b15b2c01074 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:07.206701 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02f7fa-6607-4c01-9774-5b15b2c01074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:07.209675 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f686276-df2e-47a0-b0b5-28ff328e1aac None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:07.225218 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-8f02f7fa-6607-4c01-9774-5b15b2c01074 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:44:07.226424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8f02f7fa-6607-4c01-9774-5b15b2c01074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:07.245609 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd6452-3c59-4607-a694-ec3f030c27fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:07.246216 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd6452-3c59-4607-a694-ec3f030c27fc None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:07.246588 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd6452-3c59-4607-a694-ec3f030c27fc None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:07.246852 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd6452-3c59-4607-a694-ec3f030c27fc None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:07.247474 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd6452-3c59-4607-a694-ec3f030c27fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:07.247768 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd6452-3c59-4607-a694-ec3f030c27fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:07.249250 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd6452-3c59-4607-a694-ec3f030c27fc None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:07.261177 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 393/793] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:07.266608 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd6452-3c59-4607-a694-ec3f030c27fc None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:07.301581 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 401/794] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:44:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:44:07.307054 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:07.320694 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02f7fa-6607-4c01-9774-5b15b2c01074 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:07.373226 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd6452-3c59-4607-a694-ec3f030c27fc None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:07.409001 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240941e3-0101-4606-9882-0494485b6eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:07.409647 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240941e3-0101-4606-9882-0494485b6eef None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:07.409926 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240941e3-0101-4606-9882-0494485b6eef None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:07.410203 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240941e3-0101-4606-9882-0494485b6eef None admin] PATH_INFO: `/v3/users/nova` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:07.417051 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:07.419242 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240941e3-0101-4606-9882-0494485b6eef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:07.420721 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240941e3-0101-4606-9882-0494485b6eef None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:07.425023 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02f7fa-6607-4c01-9774-5b15b2c01074 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:07.431913 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-240941e3-0101-4606-9882-0494485b6eef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:44:07.431913 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:07.431913 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:44:07.431913 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:44:07.431913 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:44:07.431913 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:44:07.431913 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:44:07.431913 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:44:07.431913 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:44:07.431913 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:44:07.431913 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:44:07.431913 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:44:07.431913 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:44:07.431913 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:44:07.431913 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:44:07.431913 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:44:07.433501 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:44:07.433501 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:44:07.433501 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:44:07.433501 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:44:07.433501 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:44:07.433501 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:44:07.433501 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:44:07.433501 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:44:07.433501 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:44:07.433501 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:44:07.433501 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:44:07.433501 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:44:07.433501 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:44:07.433501 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:44:07.433501 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:44:07.433501 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:44:07.433501 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:44:07.433501 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:44:07.439298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:44:07.439298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:44:07.439298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:44:07.439298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:44:07.439298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:44:07.439298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:44:07.439298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:44:07.439298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:44:07.439298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:44:07.439298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:44:07.439298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 394/795] 10.222.0.40 () {56 vars in 1093 bytes} [Sun Oct 30 00:44:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:44:07.439298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240941e3-0101-4606-9882-0494485b6eef None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:07.469737 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a6e17-1a0f-4b35-9503-ace964ff11e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:07.470609 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a6e17-1a0f-4b35-9503-ace964ff11e7 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:07.470883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a6e17-1a0f-4b35-9503-ace964ff11e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:07.471166 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a6e17-1a0f-4b35-9503-ace964ff11e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:07.472246 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958a6e17-1a0f-4b35-9503-ace964ff11e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:07.473747 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958a6e17-1a0f-4b35-9503-ace964ff11e7 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:07.475360 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 402/796] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:44:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:44:07.481554 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a6e17-1a0f-4b35-9503-ace964ff11e7 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:07.547625 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:07.555286 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240941e3-0101-4606-9882-0494485b6eef None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:07.582539 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a6e17-1a0f-4b35-9503-ace964ff11e7 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:07.589124 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb09eb-6906-4152-a1c1-c4f062b5000c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:07.589743 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb09eb-6906-4152-a1c1-c4f062b5000c None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:07.590015 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb09eb-6906-4152-a1c1-c4f062b5000c None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:07.590279 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb09eb-6906-4152-a1c1-c4f062b5000c None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:07.590987 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb09eb-6906-4152-a1c1-c4f062b5000c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:07.591282 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb09eb-6906-4152-a1c1-c4f062b5000c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:07.592680 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb09eb-6906-4152-a1c1-c4f062b5000c None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:07.610345 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 395/797] 10.222.0.40 () {56 vars in 1133 bytes} [Sun Oct 30 00:44:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:44:07.611022 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb09eb-6906-4152-a1c1-c4f062b5000c None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:07.619511 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a759d2c-5aa0-4f9a-a2d3-c89fa10810ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:07.620230 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a759d2c-5aa0-4f9a-a2d3-c89fa10810ea None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:07.621017 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a759d2c-5aa0-4f9a-a2d3-c89fa10810ea None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:07.621319 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a759d2c-5aa0-4f9a-a2d3-c89fa10810ea None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:07.621958 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a759d2c-5aa0-4f9a-a2d3-c89fa10810ea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:07.623370 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a759d2c-5aa0-4f9a-a2d3-c89fa10810ea None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:07.649917 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 403/798] 10.222.0.40 () {60 vars in 1141 bytes} [Sun Oct 30 00:44:07 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:44:07.650998 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a759d2c-5aa0-4f9a-a2d3-c89fa10810ea None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:07.676431 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:07.732433 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb09eb-6906-4152-a1c1-c4f062b5000c None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:07.772558 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56dc0f-569e-4e31-a2e6-3d5490c78c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:07.773168 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56dc0f-569e-4e31-a2e6-3d5490c78c1c None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:07.773472 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56dc0f-569e-4e31-a2e6-3d5490c78c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:07.773765 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56dc0f-569e-4e31-a2e6-3d5490c78c1c None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:07.774705 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56dc0f-569e-4e31-a2e6-3d5490c78c1c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:07.776126 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56dc0f-569e-4e31-a2e6-3d5490c78c1c None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:07.778090 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a759d2c-5aa0-4f9a-a2d3-c89fa10810ea None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:07.785103 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.sql.core [None req-fd56dc0f-569e-4e31-a2e6-3d5490c78c1c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 30 00:44:07.785103 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 30 00:44:07.785103 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [parameters: {'id': '9d9f3f6f752d4f608cfc6d699a85b71b', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 30 00:44:07.785103 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81352) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 30 00:44:07.793018 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-fd56dc0f-569e-4e31-a2e6-3d5490c78c1c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 30 00:44:07.793018 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:07.793018 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 00:44:07.793018 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 00:44:07.793018 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 00:44:07.793018 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 00:44:07.793018 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 00:44:07.793018 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 00:44:07.793018 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 00:44:07.793018 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application conn.query(q) Oct 30 00:44:07.793018 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 00:44:07.793018 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 00:44:07.793018 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 00:44:07.793018 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application result.read() Oct 30 00:44:07.794111 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 00:44:07.794111 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 00:44:07.794111 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 00:44:07.794111 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 00:44:07.794111 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 00:44:07.794111 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 00:44:07.794111 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 00:44:07.794111 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 00:44:07.794111 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 30 00:44:07.794111 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:44:07.794111 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 30 00:44:07.794111 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:44:07.794111 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:07.794111 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 30 00:44:07.794111 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 30 00:44:07.794111 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 30 00:44:07.794111 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 30 00:44:07.794111 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 00:44:07.795097 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application next(self.gen) Oct 30 00:44:07.795097 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 30 00:44:07.795097 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application yield resource Oct 30 00:44:07.795097 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 00:44:07.795097 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application next(self.gen) Oct 30 00:44:07.795097 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 30 00:44:07.795097 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self.session.rollback() Oct 30 00:44:07.795097 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 00:44:07.795097 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self.force_reraise() Oct 30 00:44:07.795097 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 00:44:07.795097 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise self.value Oct 30 00:44:07.795097 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 30 00:44:07.795097 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 30 00:44:07.795097 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 30 00:44:07.795097 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application session.commit() Oct 30 00:44:07.795097 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 30 00:44:07.795097 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 30 00:44:07.796278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 30 00:44:07.796278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._prepare_impl() Oct 30 00:44:07.796278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 30 00:44:07.796278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self.session.flush() Oct 30 00:44:07.796278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 30 00:44:07.796278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._flush(objects) Oct 30 00:44:07.796278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 30 00:44:07.796278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 30 00:44:07.796278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 30 00:44:07.796278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application compat.raise_( Oct 30 00:44:07.796278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 00:44:07.796278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception Oct 30 00:44:07.796278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 30 00:44:07.796278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application flush_context.execute() Oct 30 00:44:07.796278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 30 00:44:07.796278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rec.execute(self) Oct 30 00:44:07.796278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 30 00:44:07.797152 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 30 00:44:07.797152 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 30 00:44:07.797152 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 30 00:44:07.797152 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 30 00:44:07.797152 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 30 00:44:07.797152 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 30 00:44:07.797152 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 30 00:44:07.797152 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 30 00:44:07.797152 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 30 00:44:07.797152 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 30 00:44:07.797152 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 30 00:44:07.797152 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 30 00:44:07.797152 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 30 00:44:07.797152 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 30 00:44:07.797152 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 30 00:44:07.798791 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 00:44:07.798791 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception Oct 30 00:44:07.798791 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 00:44:07.798791 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 00:44:07.798791 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 00:44:07.798791 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 00:44:07.798791 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 00:44:07.798791 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 00:44:07.798791 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 00:44:07.798791 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application conn.query(q) Oct 30 00:44:07.798791 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 00:44:07.798791 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 00:44:07.798791 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 00:44:07.798791 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application result.read() Oct 30 00:44:07.798791 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 00:44:07.798791 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 00:44:07.798791 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 00:44:07.800038 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 00:44:07.800038 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 00:44:07.800038 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 00:44:07.800038 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 00:44:07.800038 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 00:44:07.800038 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 30 00:44:07.800038 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 30 00:44:07.800038 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [parameters: {'id': '9d9f3f6f752d4f608cfc6d699a85b71b', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 30 00:44:07.800038 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 30 00:44:07.800038 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:44:07.800038 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:44:07.800038 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:44:07.800038 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:07.800038 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 30 00:44:07.800038 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 30 00:44:07.800995 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 30 00:44:07.800995 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 30 00:44:07.800995 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 30 00:44:07.800995 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:44:07.800995 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:44:07.800995 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:44:07.800995 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:07.800995 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:44:07.800995 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:44:07.800995 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:44:07.800995 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:44:07.800995 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:44:07.800995 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:44:07.800995 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:44:07.800995 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:44:07.800995 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:44:07.800995 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:44:07.802144 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 30 00:44:07.802144 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 30 00:44:07.802144 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:44:07.802144 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:44:07.802144 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 30 00:44:07.802144 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 30 00:44:07.802144 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:44:07.802144 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:44:07.802144 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 30 00:44:07.802144 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 30 00:44:07.802144 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 30 00:44:07.802144 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:44:07.802144 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 396/799] 10.222.0.40 () {60 vars in 1137 bytes} [Sun Oct 30 00:44:07 2022] POST /identity/v3/domains => generated 190 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:44:07.803005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56dc0f-569e-4e31-a2e6-3d5490c78c1c None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:07.824749 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:07.827765 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2d56e-c114-4e38-ba9a-564c920d13f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:07.828617 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2d56e-c114-4e38-ba9a-564c920d13f1 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:07.829056 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2d56e-c114-4e38-ba9a-564c920d13f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:07.829898 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2d56e-c114-4e38-ba9a-564c920d13f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:07.843573 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2d56e-c114-4e38-ba9a-564c920d13f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:07.844801 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2d56e-c114-4e38-ba9a-564c920d13f1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:07.861295 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-f5e2d56e-c114-4e38-ba9a-564c920d13f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:44:07.861295 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:07.861295 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:44:07.861295 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:44:07.861295 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:44:07.861295 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:44:07.861295 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:44:07.861295 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:44:07.861295 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:44:07.861295 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:44:07.861295 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:44:07.861295 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:44:07.861295 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:44:07.861295 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:44:07.861295 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:44:07.861295 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:44:07.862460 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:44:07.862460 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:44:07.862460 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:44:07.862460 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:44:07.862460 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:44:07.862460 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:44:07.862460 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:44:07.862460 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:44:07.862460 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:44:07.862460 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:44:07.862460 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:44:07.862460 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:44:07.862460 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:44:07.862460 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:44:07.862460 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:44:07.862460 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:44:07.862460 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:44:07.863629 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:44:07.863629 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:44:07.863629 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:44:07.863629 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 404/800] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:44:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:44:07.868972 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2d56e-c114-4e38-ba9a-564c920d13f1 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:07.926062 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56dc0f-569e-4e31-a2e6-3d5490c78c1c None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:07.941394 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:07.960972 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843090fc-325d-40ff-8aec-0d61a3e8440b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:07.961752 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843090fc-325d-40ff-8aec-0d61a3e8440b None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:07.962089 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843090fc-325d-40ff-8aec-0d61a3e8440b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:07.962434 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843090fc-325d-40ff-8aec-0d61a3e8440b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:07.973209 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843090fc-325d-40ff-8aec-0d61a3e8440b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:07.974636 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843090fc-325d-40ff-8aec-0d61a3e8440b None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:07.980545 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2d56e-c114-4e38-ba9a-564c920d13f1 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:07.989769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-843090fc-325d-40ff-8aec-0d61a3e8440b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:44:07.989769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:07.989769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:44:07.989769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:44:07.989769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:44:07.989769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:44:07.989769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:44:07.989769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:44:07.989769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:44:07.989769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:44:07.989769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:44:07.989769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:44:07.989769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:44:07.989769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:44:07.989769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:44:07.989769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:44:07.990862 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:44:07.990862 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:44:07.990862 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:44:07.990862 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:44:07.990862 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:44:07.990862 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:44:07.990862 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:44:07.990862 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:44:07.990862 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:44:07.990862 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:44:07.990862 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:44:07.990862 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:44:07.990862 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:44:07.990862 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:44:07.990862 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:44:07.990862 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:44:07.990862 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:44:07.991913 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:44:07.991913 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:44:07.991913 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:44:07.993750 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 397/801] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:44:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:44:07.999602 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843090fc-325d-40ff-8aec-0d61a3e8440b None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:08.024546 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffe3b0-c816-41a6-ba8d-be3b916f26cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:08.024963 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffe3b0-c816-41a6-ba8d-be3b916f26cb None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:08.025265 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffe3b0-c816-41a6-ba8d-be3b916f26cb None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:08.025542 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffe3b0-c816-41a6-ba8d-be3b916f26cb None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:08.026173 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffe3b0-c816-41a6-ba8d-be3b916f26cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:08.027055 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffe3b0-c816-41a6-ba8d-be3b916f26cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:08.028530 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffe3b0-c816-41a6-ba8d-be3b916f26cb None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:08.041259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 405/802] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:44:08.047169 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffe3b0-c816-41a6-ba8d-be3b916f26cb None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:08.072435 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:08.108816 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843090fc-325d-40ff-8aec-0d61a3e8440b None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:08.148045 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfabc8-c9c0-45a6-95c6-7952714c2940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:08.148951 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfabc8-c9c0-45a6-95c6-7952714c2940 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:08.149530 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfabc8-c9c0-45a6-95c6-7952714c2940 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:08.149805 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfabc8-c9c0-45a6-95c6-7952714c2940 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:08.150437 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dfabc8-c9c0-45a6-95c6-7952714c2940 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:08.150594 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffe3b0-c816-41a6-ba8d-be3b916f26cb None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:08.150750 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dfabc8-c9c0-45a6-95c6-7952714c2940 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:08.152864 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dfabc8-c9c0-45a6-95c6-7952714c2940 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:08.178745 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 398/803] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:44:08.178980 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:08.190113 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c511a8-f91b-4841-9b2a-22fafdba4b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:08.190758 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c511a8-f91b-4841-9b2a-22fafdba4b18 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:08.191033 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c511a8-f91b-4841-9b2a-22fafdba4b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:08.191298 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c511a8-f91b-4841-9b2a-22fafdba4b18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:08.199396 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c511a8-f91b-4841-9b2a-22fafdba4b18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:08.200931 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c511a8-f91b-4841-9b2a-22fafdba4b18 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:08.213561 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-69c511a8-f91b-4841-9b2a-22fafdba4b18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:44:08.213561 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:08.213561 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:44:08.213561 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:44:08.213561 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:44:08.213561 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:44:08.213561 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:44:08.213561 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:44:08.213561 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:44:08.213561 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:44:08.213561 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:44:08.213561 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:44:08.213561 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:44:08.213561 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:44:08.213561 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:44:08.215084 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:44:08.215084 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:44:08.215084 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:44:08.215084 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:44:08.215084 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:44:08.215084 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:44:08.215084 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:44:08.215084 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:44:08.215084 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:44:08.215084 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:44:08.215084 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:44:08.215084 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:44:08.215084 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:44:08.215084 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:44:08.215084 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:44:08.215084 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:44:08.215084 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:44:08.216465 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:44:08.216465 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:44:08.216465 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:44:08.216465 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:44:08.216465 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:44:08.216465 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:44:08.216465 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:44:08.216465 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:44:08.216465 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 406/804] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:44:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:44:08.221178 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfabc8-c9c0-45a6-95c6-7952714c2940 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:08.330089 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfabc8-c9c0-45a6-95c6-7952714c2940 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:08.361715 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:08.368152 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbade6-ecad-4c0e-813d-49879a88ed56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:08.368750 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbade6-ecad-4c0e-813d-49879a88ed56 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:08.369017 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbade6-ecad-4c0e-813d-49879a88ed56 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:08.369320 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbade6-ecad-4c0e-813d-49879a88ed56 None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:08.369993 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bbade6-ecad-4c0e-813d-49879a88ed56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:08.370316 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bbade6-ecad-4c0e-813d-49879a88ed56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:08.371715 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bbade6-ecad-4c0e-813d-49879a88ed56 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:08.384094 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 399/805] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Oct 30 00:44:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:44:08.390473 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c511a8-f91b-4841-9b2a-22fafdba4b18 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:08.501867 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c511a8-f91b-4841-9b2a-22fafdba4b18 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:08.536649 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e43210-7098-44b6-b95b-2b463a2f9db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:08.537333 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e43210-7098-44b6-b95b-2b463a2f9db9 None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:08.537614 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e43210-7098-44b6-b95b-2b463a2f9db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:08.537888 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e43210-7098-44b6-b95b-2b463a2f9db9 None admin] PATH_INFO: `/v3/projects/8969ed754fe24784a2025cbdbf6f1a8b/users/4237b425d9fa4a60b10802e5b108d542/roles/c80cdb94073e47d0845175cf6e618c64` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:08.540053 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e43210-7098-44b6-b95b-2b463a2f9db9 None admin] RBAC: Authorizing `identity:create_grant(project_id=8969ed754fe24784a2025cbdbf6f1a8b, user_id=4237b425d9fa4a60b10802e5b108d542, role_id=c80cdb94073e47d0845175cf6e618c64)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:08.541509 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e43210-7098-44b6-b95b-2b463a2f9db9 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:08.554107 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 407/806] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Oct 30 00:44:08 2022] PUT /identity/v3/projects/8969ed754fe24784a2025cbdbf6f1a8b/users/4237b425d9fa4a60b10802e5b108d542/roles/c80cdb94073e47d0845175cf6e618c64 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:44:09.862448 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b3390-4b3d-41b8-87c8-75d7b78b8718 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:09.862995 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b3390-4b3d-41b8-87c8-75d7b78b8718 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:09.862995 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b3390-4b3d-41b8-87c8-75d7b78b8718 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:09.864478 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 400/807] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:44:09.869438 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174739d-92d2-422e-b101-4d19593ad92a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:09.869815 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174739d-92d2-422e-b101-4d19593ad92a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:09.870104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174739d-92d2-422e-b101-4d19593ad92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:09.888391 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-9174739d-92d2-422e-b101-4d19593ad92a None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:44:09.889609 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9174739d-92d2-422e-b101-4d19593ad92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:09.930366 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:09.955351 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 408/808] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:44:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:44:10.228142 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b3390-4b3d-41b8-87c8-75d7b78b8718 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:10.328789 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b3390-4b3d-41b8-87c8-75d7b78b8718 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:10.360323 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3fb4f-2dfe-46c3-8fa4-c8cb5d9cdb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:10.360931 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3fb4f-2dfe-46c3-8fa4-c8cb5d9cdb2b None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:10.361288 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3fb4f-2dfe-46c3-8fa4-c8cb5d9cdb2b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:10.361492 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3fb4f-2dfe-46c3-8fa4-c8cb5d9cdb2b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:10.362579 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3fb4f-2dfe-46c3-8fa4-c8cb5d9cdb2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:10.363989 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3fb4f-2dfe-46c3-8fa4-c8cb5d9cdb2b None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:10.365571 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 401/809] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:44:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:10.371798 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174739d-92d2-422e-b101-4d19593ad92a None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:10.466585 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174739d-92d2-422e-b101-4d19593ad92a None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:10.499892 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4ff26-4ac8-4aab-a7d0-ed5217c290b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:10.500486 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4ff26-4ac8-4aab-a7d0-ed5217c290b8 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:10.500760 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4ff26-4ac8-4aab-a7d0-ed5217c290b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:10.501027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4ff26-4ac8-4aab-a7d0-ed5217c290b8 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:10.501703 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4ff26-4ac8-4aab-a7d0-ed5217c290b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:10.503117 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4ff26-4ac8-4aab-a7d0-ed5217c290b8 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:10.523569 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 409/810] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Oct 30 00:44:10 2022] POST /identity/v3/users => generated 285 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:44:10.664479 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ac609-4637-459b-a504-c9246fd1d24d None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:10.664479 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ac609-4637-459b-a504-c9246fd1d24d None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:10.664479 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ac609-4637-459b-a504-c9246fd1d24d None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:10.669252 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 402/811] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:44:10.671683 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999daac2-9847-41bc-bf0d-dbcf197fd294 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:10.671971 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999daac2-9847-41bc-bf0d-dbcf197fd294 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:10.672245 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999daac2-9847-41bc-bf0d-dbcf197fd294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:10.691473 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-999daac2-9847-41bc-bf0d-dbcf197fd294 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:44:10.692657 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-999daac2-9847-41bc-bf0d-dbcf197fd294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:10.719010 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:10.760986 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 410/812] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:44:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:44:11.025978 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ac609-4637-459b-a504-c9246fd1d24d None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:11.083420 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:11.124831 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ac609-4637-459b-a504-c9246fd1d24d None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:11.157381 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb970096-431f-4dcb-8088-b2005a29d7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:11.157995 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb970096-431f-4dcb-8088-b2005a29d7b5 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:11.158270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb970096-431f-4dcb-8088-b2005a29d7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:11.158536 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb970096-431f-4dcb-8088-b2005a29d7b5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:11.169322 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb970096-431f-4dcb-8088-b2005a29d7b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:44:11.173952 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-eb970096-431f-4dcb-8088-b2005a29d7b5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 30 00:44:11.173952 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:11.173952 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:44:11.173952 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:44:11.173952 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:44:11.173952 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:44:11.173952 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:44:11.173952 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:44:11.173952 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:44:11.173952 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:44:11.173952 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:44:11.173952 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:44:11.173952 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:44:11.173952 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:44:11.173952 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:44:11.173952 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:44:11.174946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:44:11.174946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:44:11.174946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:44:11.174946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:44:11.174946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:44:11.174946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:44:11.174946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:44:11.174946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:44:11.174946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:44:11.174946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:44:11.174946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:44:11.174946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:44:11.174946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:44:11.174946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:44:11.174946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:44:11.174946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:44:11.175866 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:44:11.175866 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:44:11.175866 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:44:11.175866 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:44:11.175866 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:44:11.175866 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:44:11.175866 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:44:11.175866 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:44:11.175866 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:44:11.175866 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:44:11.175866 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 30 00:44:11.175866 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:44:11.175866 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 403/813] 10.222.0.40 () {56 vars in 1120 bytes} [Sun Oct 30 00:44:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:44:11.181131 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999daac2-9847-41bc-bf0d-dbcf197fd294 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:11.278091 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999daac2-9847-41bc-bf0d-dbcf197fd294 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:11.313754 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba675d65-5be5-4d22-bd12-278714e51bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:11.314352 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba675d65-5be5-4d22-bd12-278714e51bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:11.314624 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba675d65-5be5-4d22-bd12-278714e51bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:11.314889 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba675d65-5be5-4d22-bd12-278714e51bb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:11.315538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba675d65-5be5-4d22-bd12-278714e51bb1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:11.315830 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba675d65-5be5-4d22-bd12-278714e51bb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:11.317176 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba675d65-5be5-4d22-bd12-278714e51bb1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:11.324908 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 411/814] 10.222.0.40 () {56 vars in 1115 bytes} [Sun Oct 30 00:44:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:11.331343 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb970096-431f-4dcb-8088-b2005a29d7b5 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:11.428638 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb970096-431f-4dcb-8088-b2005a29d7b5 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:11.446215 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:11.463216 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e853e7-66fa-4d6f-97a5-dae608b4247a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:11.464371 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e853e7-66fa-4d6f-97a5-dae608b4247a None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:11.464653 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e853e7-66fa-4d6f-97a5-dae608b4247a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:11.464919 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e853e7-66fa-4d6f-97a5-dae608b4247a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:11.474923 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e853e7-66fa-4d6f-97a5-dae608b4247a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:11.476326 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e853e7-66fa-4d6f-97a5-dae608b4247a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:11.489761 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-82e853e7-66fa-4d6f-97a5-dae608b4247a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:44:11.489761 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:11.489761 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:44:11.489761 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:44:11.489761 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:44:11.489761 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:44:11.489761 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:44:11.489761 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:44:11.489761 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:44:11.489761 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:44:11.489761 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:44:11.489761 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:44:11.489761 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:44:11.489761 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:44:11.489761 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:44:11.489761 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:44:11.490748 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:44:11.490748 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:44:11.490748 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:44:11.490748 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:44:11.490748 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:44:11.490748 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:44:11.490748 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:44:11.490748 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:44:11.490748 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:44:11.490748 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:44:11.490748 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:44:11.490748 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:44:11.490748 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:44:11.490748 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:44:11.490748 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:44:11.490748 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:44:11.490748 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:44:11.492005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:44:11.492005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:44:11.492005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:44:11.492005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 404/815] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:44:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:44:11.496585 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba675d65-5be5-4d22-bd12-278714e51bb1 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:11.521537 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:11.593986 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba675d65-5be5-4d22-bd12-278714e51bb1 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:11.625967 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa93c1b-1471-4ac2-9f8b-eb96f9d2e4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:11.626551 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa93c1b-1471-4ac2-9f8b-eb96f9d2e4db None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:11.626828 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa93c1b-1471-4ac2-9f8b-eb96f9d2e4db None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:11.627097 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa93c1b-1471-4ac2-9f8b-eb96f9d2e4db None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:11.627724 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa93c1b-1471-4ac2-9f8b-eb96f9d2e4db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:11.628020 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa93c1b-1471-4ac2-9f8b-eb96f9d2e4db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:11.629401 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa93c1b-1471-4ac2-9f8b-eb96f9d2e4db None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:11.641268 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 412/816] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:11.646830 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e853e7-66fa-4d6f-97a5-dae608b4247a None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:11.744621 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e853e7-66fa-4d6f-97a5-dae608b4247a None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:11.776983 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f73df5-2123-457a-9ca2-c7d834cfb10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:11.777627 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f73df5-2123-457a-9ca2-c7d834cfb10e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:11.777897 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f73df5-2123-457a-9ca2-c7d834cfb10e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:11.778156 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f73df5-2123-457a-9ca2-c7d834cfb10e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:11.785390 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f73df5-2123-457a-9ca2-c7d834cfb10e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:11.786803 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f73df5-2123-457a-9ca2-c7d834cfb10e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:11.798028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-a3f73df5-2123-457a-9ca2-c7d834cfb10e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:44:11.798028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:11.798028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:44:11.798028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:44:11.798028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:44:11.798028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:44:11.798028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:44:11.798028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:44:11.798028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:44:11.798028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:44:11.798028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:44:11.798028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:44:11.798028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:44:11.798028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:44:11.798028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:44:11.798028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:44:11.799166 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:44:11.799166 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:44:11.799166 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:44:11.799166 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:44:11.799166 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:44:11.799166 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:44:11.799166 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:44:11.799166 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:44:11.799166 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:44:11.799166 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:44:11.799166 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:44:11.799166 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:44:11.799166 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:44:11.799166 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:44:11.799166 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:44:11.799166 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:44:11.799166 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:44:11.799166 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:44:11.800387 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:44:11.800387 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:44:11.800387 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:44:11.800387 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:44:11.800387 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:44:11.800387 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:44:11.800387 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:44:11.800387 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:44:11.800387 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:44:11.800387 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:44:11.801332 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 405/817] 10.222.0.40 () {56 vars in 1093 bytes} [Sun Oct 30 00:44:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:44:11.804760 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa93c1b-1471-4ac2-9f8b-eb96f9d2e4db None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:11.884517 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:11.900158 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa93c1b-1471-4ac2-9f8b-eb96f9d2e4db None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:11.932967 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff34d7f-a926-4fab-9c08-a2020e0576ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:11.933583 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff34d7f-a926-4fab-9c08-a2020e0576ba None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:11.933858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff34d7f-a926-4fab-9c08-a2020e0576ba None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:11.934126 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff34d7f-a926-4fab-9c08-a2020e0576ba None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:11.934828 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff34d7f-a926-4fab-9c08-a2020e0576ba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:11.935124 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff34d7f-a926-4fab-9c08-a2020e0576ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:11.936523 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff34d7f-a926-4fab-9c08-a2020e0576ba None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:11.952694 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 413/818] 10.222.0.40 () {56 vars in 1133 bytes} [Sun Oct 30 00:44:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:11.958374 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f73df5-2123-457a-9ca2-c7d834cfb10e None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:11.988722 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:12.057395 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f73df5-2123-457a-9ca2-c7d834cfb10e None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:12.090060 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1cd2f-9f29-4b28-9db7-e0be3474ea47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:12.090647 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1cd2f-9f29-4b28-9db7-e0be3474ea47 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:12.090922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1cd2f-9f29-4b28-9db7-e0be3474ea47 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:12.091192 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1cd2f-9f29-4b28-9db7-e0be3474ea47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:12.155951 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1cd2f-9f29-4b28-9db7-e0be3474ea47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:12.157357 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1cd2f-9f29-4b28-9db7-e0be3474ea47 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:12.185327 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:12.253093 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 406/819] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Oct 30 00:44:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 30 00:44:12.258777 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff34d7f-a926-4fab-9c08-a2020e0576ba None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:12.357156 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff34d7f-a926-4fab-9c08-a2020e0576ba None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:12.390490 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee6c4f-56ce-403c-bce2-dcb4ca27e823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:12.391099 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee6c4f-56ce-403c-bce2-dcb4ca27e823 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:12.391374 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee6c4f-56ce-403c-bce2-dcb4ca27e823 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:12.391640 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee6c4f-56ce-403c-bce2-dcb4ca27e823 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:12.401483 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee6c4f-56ce-403c-bce2-dcb4ca27e823 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:12.402903 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee6c4f-56ce-403c-bce2-dcb4ca27e823 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:12.404542 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:12.418114 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-49ee6c4f-56ce-403c-bce2-dcb4ca27e823 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:44:12.418114 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:12.418114 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:44:12.418114 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:44:12.418114 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:44:12.418114 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:44:12.418114 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:44:12.418114 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:44:12.418114 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:44:12.418114 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:44:12.418114 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:44:12.418114 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:44:12.418114 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:44:12.418114 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:44:12.418114 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:44:12.418114 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:44:12.419217 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:44:12.419217 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:44:12.419217 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:44:12.419217 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:44:12.419217 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:44:12.419217 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:44:12.419217 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:44:12.419217 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:44:12.419217 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:44:12.419217 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:44:12.419217 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:44:12.419217 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:44:12.419217 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:44:12.419217 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:44:12.419217 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:44:12.419217 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:44:12.419217 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:44:12.420142 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:44:12.420142 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:44:12.420142 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:44:12.420549 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 414/820] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:44:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:44:12.424777 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1cd2f-9f29-4b28-9db7-e0be3474ea47 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:12.520273 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1cd2f-9f29-4b28-9db7-e0be3474ea47 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:12.547548 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:12.553639 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67605d-abd7-4619-a84b-025ed70890cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:12.554228 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67605d-abd7-4619-a84b-025ed70890cb None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:12.554499 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67605d-abd7-4619-a84b-025ed70890cb None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:12.554761 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67605d-abd7-4619-a84b-025ed70890cb None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:12.555378 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67605d-abd7-4619-a84b-025ed70890cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:12.555672 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67605d-abd7-4619-a84b-025ed70890cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:12.557006 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67605d-abd7-4619-a84b-025ed70890cb None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:12.568824 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 407/821] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:44:12.575258 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee6c4f-56ce-403c-bce2-dcb4ca27e823 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:12.676873 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee6c4f-56ce-403c-bce2-dcb4ca27e823 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:12.689711 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b702a1f-7ba1-4885-91c0-c3d45ee4b378 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:12.689994 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b702a1f-7ba1-4885-91c0-c3d45ee4b378 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:12.690267 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b702a1f-7ba1-4885-91c0-c3d45ee4b378 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:12.691608 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 408/822] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:44:12.696409 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca8aaf-df0c-4b47-bd3b-09d6b09ac184 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:12.696698 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca8aaf-df0c-4b47-bd3b-09d6b09ac184 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:12.696972 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca8aaf-df0c-4b47-bd3b-09d6b09ac184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:12.710851 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e70753-5b45-4432-8a20-74887f062329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:12.711464 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e70753-5b45-4432-8a20-74887f062329 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:12.711742 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e70753-5b45-4432-8a20-74887f062329 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:12.712009 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e70753-5b45-4432-8a20-74887f062329 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:12.715291 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-f8ca8aaf-df0c-4b47-bd3b-09d6b09ac184 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:44:12.716473 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-f8ca8aaf-df0c-4b47-bd3b-09d6b09ac184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:12.718624 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e70753-5b45-4432-8a20-74887f062329 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:12.720040 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e70753-5b45-4432-8a20-74887f062329 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:12.731644 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-53e70753-5b45-4432-8a20-74887f062329 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:44:12.731644 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:12.731644 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:44:12.731644 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:44:12.731644 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:44:12.731644 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:44:12.731644 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:44:12.731644 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:44:12.731644 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:44:12.731644 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:44:12.731644 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:44:12.731644 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:44:12.731644 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:44:12.731644 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:44:12.731644 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:44:12.732670 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:44:12.732670 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:44:12.732670 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:44:12.732670 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:44:12.732670 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:44:12.732670 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:44:12.732670 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:44:12.732670 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:44:12.732670 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:44:12.732670 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:44:12.732670 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:44:12.732670 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:44:12.732670 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:44:12.732670 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:44:12.732670 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:44:12.732670 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:44:12.732670 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:44:12.733619 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:44:12.733619 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:44:12.733619 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:44:12.733619 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:44:12.733619 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:44:12.733619 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:44:12.733619 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:44:12.733619 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:44:12.733619 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 415/823] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:44:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:44:12.738525 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e70753-5b45-4432-8a20-74887f062329 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:12.783255 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 409/824] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:44:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:44:12.792413 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:12.835229 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e70753-5b45-4432-8a20-74887f062329 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:12.866856 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e73673-b36b-44c3-acfe-e48411ab47cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:12.867434 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e73673-b36b-44c3-acfe-e48411ab47cf None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:12.867706 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e73673-b36b-44c3-acfe-e48411ab47cf None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:12.867970 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e73673-b36b-44c3-acfe-e48411ab47cf None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:12.868636 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e73673-b36b-44c3-acfe-e48411ab47cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:12.868931 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e73673-b36b-44c3-acfe-e48411ab47cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:12.870406 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e73673-b36b-44c3-acfe-e48411ab47cf None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:12.882314 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 416/825] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Oct 30 00:44:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:44:12.888949 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca8aaf-df0c-4b47-bd3b-09d6b09ac184 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:12.985307 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca8aaf-df0c-4b47-bd3b-09d6b09ac184 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:13.005139 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:13.019438 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d849409-d966-4dac-9431-a049b74f7229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:13.020019 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d849409-d966-4dac-9431-a049b74f7229 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:13.020286 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d849409-d966-4dac-9431-a049b74f7229 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:13.020551 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d849409-d966-4dac-9431-a049b74f7229 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:13.021298 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d849409-d966-4dac-9431-a049b74f7229 None admin] RBAC: Adding query filter params (role.id=c80cdb94073e47d0845175cf6e618c64, scope.project.id=8969ed754fe24784a2025cbdbf6f1a8b, user.id=4237b425d9fa4a60b10802e5b108d542) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:13.021594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d849409-d966-4dac-9431-a049b74f7229 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:13.022986 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d849409-d966-4dac-9431-a049b74f7229 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:13.029416 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 410/826] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Oct 30 00:44:12 2022] GET /identity/v3/role_assignments?user.id=4237b425d9fa4a60b10802e5b108d542&scope.project.id=8969ed754fe24784a2025cbdbf6f1a8b&role.id=c80cdb94073e47d0845175cf6e618c64 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:13.048767 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e73673-b36b-44c3-acfe-e48411ab47cf None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:13.152869 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e73673-b36b-44c3-acfe-e48411ab47cf None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:13.168391 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:13.188839 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b4c70-f698-465b-84ad-8a6332e34a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:13.189491 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b4c70-f698-465b-84ad-8a6332e34a28 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:13.189771 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b4c70-f698-465b-84ad-8a6332e34a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:13.190038 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b4c70-f698-465b-84ad-8a6332e34a28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:13.200075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b4c70-f698-465b-84ad-8a6332e34a28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:44:13.204732 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-b05b4c70-f698-465b-84ad-8a6332e34a28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:44:13.204732 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:13.204732 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:44:13.204732 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:44:13.204732 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:44:13.204732 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:44:13.204732 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:44:13.204732 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:44:13.204732 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:44:13.204732 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:44:13.204732 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:44:13.204732 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:44:13.204732 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:44:13.204732 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:44:13.204732 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:44:13.204732 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:44:13.205691 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:44:13.205691 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:44:13.205691 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:44:13.205691 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:44:13.205691 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:44:13.205691 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:44:13.205691 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:44:13.205691 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:44:13.205691 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:44:13.205691 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:44:13.205691 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:44:13.205691 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:44:13.205691 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:44:13.205691 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:44:13.205691 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:44:13.205691 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:44:13.206534 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:44:13.206534 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:44:13.206534 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:44:13.206534 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:44:13.206534 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:44:13.206534 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:44:13.206534 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:44:13.206534 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:44:13.206534 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:44:13.206534 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:44:13.206534 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:44:13.206534 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:44:13.206534 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 417/827] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Oct 30 00:44:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:44:13.211906 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d849409-d966-4dac-9431-a049b74f7229 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:13.318415 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d849409-d966-4dac-9431-a049b74f7229 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:13.352042 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3c2fc-a3e5-4cae-97f2-92b9e16b317a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:13.352634 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3c2fc-a3e5-4cae-97f2-92b9e16b317a None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:13.352908 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3c2fc-a3e5-4cae-97f2-92b9e16b317a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:13.353174 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3c2fc-a3e5-4cae-97f2-92b9e16b317a None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:13.353847 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3c2fc-a3e5-4cae-97f2-92b9e16b317a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:13.354149 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3c2fc-a3e5-4cae-97f2-92b9e16b317a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:13.355545 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3c2fc-a3e5-4cae-97f2-92b9e16b317a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:13.363590 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 411/828] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:44:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:13.369484 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b4c70-f698-465b-84ad-8a6332e34a28 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:13.475971 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b4c70-f698-465b-84ad-8a6332e34a28 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:13.509747 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b1381-c85b-4013-bccc-52b6b0dbbd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:13.510364 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b1381-c85b-4013-bccc-52b6b0dbbd5f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:13.510638 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b1381-c85b-4013-bccc-52b6b0dbbd5f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:13.511435 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b1381-c85b-4013-bccc-52b6b0dbbd5f None admin] PATH_INFO: `/v3/users/b82bb33b152e4620bd6c9260f95df6ae` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:13.524855 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b1381-c85b-4013-bccc-52b6b0dbbd5f None admin] RBAC: Authorizing `identity:get_user(user_id=b82bb33b152e4620bd6c9260f95df6ae)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:13.526342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b1381-c85b-4013-bccc-52b6b0dbbd5f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:13.528597 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 418/829] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:44:13 2022] GET /identity/v3/users/b82bb33b152e4620bd6c9260f95df6ae => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:44:13.534473 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3c2fc-a3e5-4cae-97f2-92b9e16b317a None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:13.582514 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:13.634769 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3c2fc-a3e5-4cae-97f2-92b9e16b317a None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:13.668184 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500cfb1c-a143-4c56-a51d-81fe98b3bb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:13.668833 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cfb1c-a143-4c56-a51d-81fe98b3bb82 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:13.669072 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cfb1c-a143-4c56-a51d-81fe98b3bb82 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:13.669379 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cfb1c-a143-4c56-a51d-81fe98b3bb82 None admin] PATH_INFO: `/v3/projects/72663129724340e39541912b3e5150d3` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:13.670879 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500cfb1c-a143-4c56-a51d-81fe98b3bb82 None admin] RBAC: Authorizing `identity:get_project(project_id=72663129724340e39541912b3e5150d3)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:13.671889 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500cfb1c-a143-4c56-a51d-81fe98b3bb82 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:13.673535 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 412/830] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Oct 30 00:44:13 2022] GET /identity/v3/projects/72663129724340e39541912b3e5150d3 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:13.679475 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b1381-c85b-4013-bccc-52b6b0dbbd5f None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:13.710399 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:13.781427 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b1381-c85b-4013-bccc-52b6b0dbbd5f None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:13.814519 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25efc9d-72d7-4da4-83e1-0c9f823b5a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:13.815159 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25efc9d-72d7-4da4-83e1-0c9f823b5a67 None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:13.815432 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25efc9d-72d7-4da4-83e1-0c9f823b5a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:13.815701 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25efc9d-72d7-4da4-83e1-0c9f823b5a67 None admin] PATH_INFO: `/v3/projects/72663129724340e39541912b3e5150d3/users/b82bb33b152e4620bd6c9260f95df6ae/roles/17d0330d6df84d3091d7ef234dfc4e6b` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:13.817584 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25efc9d-72d7-4da4-83e1-0c9f823b5a67 None admin] RBAC: Authorizing `identity:create_grant(project_id=72663129724340e39541912b3e5150d3, user_id=b82bb33b152e4620bd6c9260f95df6ae, role_id=17d0330d6df84d3091d7ef234dfc4e6b)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:13.818982 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25efc9d-72d7-4da4-83e1-0c9f823b5a67 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:13.834357 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 419/831] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Oct 30 00:44:13 2022] PUT /identity/v3/projects/72663129724340e39541912b3e5150d3/users/b82bb33b152e4620bd6c9260f95df6ae/roles/17d0330d6df84d3091d7ef234dfc4e6b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:44:15.926720 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc2119-242d-4365-a958-4db7cb18537a None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:15.927231 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc2119-242d-4365-a958-4db7cb18537a None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:15.927231 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc2119-242d-4365-a958-4db7cb18537a None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:15.928496 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 413/832] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:44:15.933912 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0088ee-ded6-4c8e-aca4-da5bc68a5dff None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:15.934345 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0088ee-ded6-4c8e-aca4-da5bc68a5dff None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:15.934445 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0088ee-ded6-4c8e-aca4-da5bc68a5dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:15.952551 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-2c0088ee-ded6-4c8e-aca4-da5bc68a5dff None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:44:15.953739 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2c0088ee-ded6-4c8e-aca4-da5bc68a5dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:16.017004 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 420/833] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:44:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:44:16.284461 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc2119-242d-4365-a958-4db7cb18537a None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:16.381418 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc2119-242d-4365-a958-4db7cb18537a None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:16.394662 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:16.413844 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418da5ab-eee1-4da4-a3e6-f67a70f7a12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:16.414443 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418da5ab-eee1-4da4-a3e6-f67a70f7a12d None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:16.414720 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418da5ab-eee1-4da4-a3e6-f67a70f7a12d None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:16.414986 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418da5ab-eee1-4da4-a3e6-f67a70f7a12d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:16.424920 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418da5ab-eee1-4da4-a3e6-f67a70f7a12d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:44:16.429570 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-418da5ab-eee1-4da4-a3e6-f67a70f7a12d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:44:16.429570 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:16.429570 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:44:16.429570 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:44:16.429570 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:44:16.429570 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:44:16.429570 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:44:16.429570 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:44:16.429570 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:44:16.429570 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:44:16.429570 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:44:16.429570 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:44:16.429570 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:44:16.429570 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:44:16.429570 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:44:16.429570 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:44:16.430733 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:44:16.430733 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:44:16.430733 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:44:16.430733 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:44:16.430733 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:44:16.430733 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:44:16.430733 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:44:16.430733 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:44:16.430733 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:44:16.430733 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:44:16.430733 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:44:16.430733 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:44:16.430733 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:44:16.430733 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:44:16.430733 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:44:16.430733 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:44:16.431690 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:44:16.431690 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:44:16.431690 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:44:16.431690 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:44:16.431690 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:44:16.431690 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:44:16.431690 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:44:16.431690 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:44:16.431690 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:44:16.431690 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:44:16.431690 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:44:16.431690 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:44:16.431690 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 414/834] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Oct 30 00:44:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:44:16.437144 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0088ee-ded6-4c8e-aca4-da5bc68a5dff None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:16.460071 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:16.531977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0088ee-ded6-4c8e-aca4-da5bc68a5dff None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:16.565142 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952589fc-d70c-4709-92d2-bacc56da62f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:16.565697 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952589fc-d70c-4709-92d2-bacc56da62f8 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:16.565969 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952589fc-d70c-4709-92d2-bacc56da62f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:16.566234 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952589fc-d70c-4709-92d2-bacc56da62f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:16.566875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952589fc-d70c-4709-92d2-bacc56da62f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:16.567168 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952589fc-d70c-4709-92d2-bacc56da62f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:16.568518 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952589fc-d70c-4709-92d2-bacc56da62f8 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:16.576073 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 421/835] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:44:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:16.582000 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418da5ab-eee1-4da4-a3e6-f67a70f7a12d None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:16.676766 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418da5ab-eee1-4da4-a3e6-f67a70f7a12d None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:16.708559 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda70e53-c7da-4308-85d3-a199f69a897e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:16.709157 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda70e53-c7da-4308-85d3-a199f69a897e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:16.709455 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda70e53-c7da-4308-85d3-a199f69a897e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:16.709720 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda70e53-c7da-4308-85d3-a199f69a897e None admin] PATH_INFO: `/v3/users/b82bb33b152e4620bd6c9260f95df6ae` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:16.710801 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda70e53-c7da-4308-85d3-a199f69a897e None admin] RBAC: Authorizing `identity:get_user(user_id=b82bb33b152e4620bd6c9260f95df6ae)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:16.712207 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda70e53-c7da-4308-85d3-a199f69a897e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:16.713797 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 415/836] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:44:16 2022] GET /identity/v3/users/b82bb33b152e4620bd6c9260f95df6ae => generated 285 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:16.719507 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952589fc-d70c-4709-92d2-bacc56da62f8 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:16.799465 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:16.815039 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952589fc-d70c-4709-92d2-bacc56da62f8 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:16.846334 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63f8fa-69aa-419a-97ea-0f4d0bc8cf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:16.846852 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63f8fa-69aa-419a-97ea-0f4d0bc8cf2b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:16.847125 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63f8fa-69aa-419a-97ea-0f4d0bc8cf2b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:16.847391 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63f8fa-69aa-419a-97ea-0f4d0bc8cf2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:16.911460 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63f8fa-69aa-419a-97ea-0f4d0bc8cf2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:16.912870 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63f8fa-69aa-419a-97ea-0f4d0bc8cf2b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:16.991364 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:17.007605 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 422/837] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Oct 30 00:44:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 30 00:44:17.013503 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda70e53-c7da-4308-85d3-a199f69a897e None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:17.055252 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:17.109255 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda70e53-c7da-4308-85d3-a199f69a897e None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:17.140076 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71fb08-6509-48e2-8b08-b73146b7e493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:17.140672 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71fb08-6509-48e2-8b08-b73146b7e493 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:17.140941 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71fb08-6509-48e2-8b08-b73146b7e493 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:17.141226 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71fb08-6509-48e2-8b08-b73146b7e493 None admin] PATH_INFO: `/v3/projects/72663129724340e39541912b3e5150d3` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:17.142297 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71fb08-6509-48e2-8b08-b73146b7e493 None admin] RBAC: Authorizing `identity:get_project(project_id=72663129724340e39541912b3e5150d3)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:17.143703 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71fb08-6509-48e2-8b08-b73146b7e493 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:17.145293 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 416/838] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Oct 30 00:44:17 2022] GET /identity/v3/projects/72663129724340e39541912b3e5150d3 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:17.151920 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63f8fa-69aa-419a-97ea-0f4d0bc8cf2b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:17.244967 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63f8fa-69aa-419a-97ea-0f4d0bc8cf2b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:17.277866 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95e4ba-2b6a-4590-9c4f-15dd9ee70080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:17.278446 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95e4ba-2b6a-4590-9c4f-15dd9ee70080 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:17.278719 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95e4ba-2b6a-4590-9c4f-15dd9ee70080 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:17.278985 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95e4ba-2b6a-4590-9c4f-15dd9ee70080 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:17.279686 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95e4ba-2b6a-4590-9c4f-15dd9ee70080 None admin] RBAC: Adding query filter params (role.id=17d0330d6df84d3091d7ef234dfc4e6b, scope.project.id=72663129724340e39541912b3e5150d3, user.id=b82bb33b152e4620bd6c9260f95df6ae) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:17.279988 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95e4ba-2b6a-4590-9c4f-15dd9ee70080 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:17.281409 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95e4ba-2b6a-4590-9c4f-15dd9ee70080 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:17.286824 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 423/839] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Oct 30 00:44:17 2022] GET /identity/v3/role_assignments?user.id=b82bb33b152e4620bd6c9260f95df6ae&scope.project.id=72663129724340e39541912b3e5150d3&role.id=17d0330d6df84d3091d7ef234dfc4e6b => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:19.424792 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30d38d-8db3-4368-bc4b-0ec5818e925a None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:19.425345 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30d38d-8db3-4368-bc4b-0ec5818e925a None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:19.425465 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30d38d-8db3-4368-bc4b-0ec5818e925a None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:19.426704 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 417/840] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:44:19.431967 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb66bf8-dff0-4e03-981f-eb59978db720 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:19.432889 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb66bf8-dff0-4e03-981f-eb59978db720 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:19.432988 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb66bf8-dff0-4e03-981f-eb59978db720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:19.451086 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-5cb66bf8-dff0-4e03-981f-eb59978db720 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:44:19.452245 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-5cb66bf8-dff0-4e03-981f-eb59978db720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:19.493339 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:19.516054 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 424/841] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:44:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:44:19.785276 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30d38d-8db3-4368-bc4b-0ec5818e925a None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:19.884339 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30d38d-8db3-4368-bc4b-0ec5818e925a None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:19.894098 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:19.918052 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391eb522-b070-446c-aebe-4b3ee55d437b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:19.918651 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391eb522-b070-446c-aebe-4b3ee55d437b None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:19.918924 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391eb522-b070-446c-aebe-4b3ee55d437b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:19.919187 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391eb522-b070-446c-aebe-4b3ee55d437b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:19.920261 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391eb522-b070-446c-aebe-4b3ee55d437b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:19.921734 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391eb522-b070-446c-aebe-4b3ee55d437b None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:19.923239 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 418/842] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:44:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:19.928832 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb66bf8-dff0-4e03-981f-eb59978db720 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:20.022148 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb66bf8-dff0-4e03-981f-eb59978db720 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:20.055253 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d6436-8618-4dd6-9fee-e26745d9ac65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:20.055777 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d6436-8618-4dd6-9fee-e26745d9ac65 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:20.056048 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d6436-8618-4dd6-9fee-e26745d9ac65 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:20.056311 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d6436-8618-4dd6-9fee-e26745d9ac65 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:20.056950 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d6436-8618-4dd6-9fee-e26745d9ac65 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:20.058402 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d6436-8618-4dd6-9fee-e26745d9ac65 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:20.078815 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 425/843] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Oct 30 00:44:19 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:44:22.221386 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cc4d8-c64f-4664-9463-e16e99dc8e2b None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:22.221942 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cc4d8-c64f-4664-9463-e16e99dc8e2b None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:22.221942 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cc4d8-c64f-4664-9463-e16e99dc8e2b None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:22.223252 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 419/844] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:44:22.228308 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33e633-e3b1-4812-bcfd-ad91ad81ad15 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:22.228692 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33e633-e3b1-4812-bcfd-ad91ad81ad15 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:22.228858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33e633-e3b1-4812-bcfd-ad91ad81ad15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:22.247691 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-7b33e633-e3b1-4812-bcfd-ad91ad81ad15 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:44:22.248858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7b33e633-e3b1-4812-bcfd-ad91ad81ad15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:22.274989 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:22.314575 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 426/845] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:44:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:44:22.579451 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9cc4d8-c64f-4664-9463-e16e99dc8e2b None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:22.678165 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9cc4d8-c64f-4664-9463-e16e99dc8e2b None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:22.710203 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec5b46-7a8c-438a-b24e-d7dfb210c719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:22.710807 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec5b46-7a8c-438a-b24e-d7dfb210c719 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:22.711081 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec5b46-7a8c-438a-b24e-d7dfb210c719 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:22.711349 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec5b46-7a8c-438a-b24e-d7dfb210c719 None admin] PATH_INFO: `/v3/roles/b63857cb2ff04d189523309091368e81` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:22.712707 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec5b46-7a8c-438a-b24e-d7dfb210c719 None admin] RBAC: Authorizing `identity:get_role(role_id=b63857cb2ff04d189523309091368e81)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:22.714108 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec5b46-7a8c-438a-b24e-d7dfb210c719 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:22.715394 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 420/846] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:44:22 2022] GET /identity/v3/roles/b63857cb2ff04d189523309091368e81 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:22.721111 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33e633-e3b1-4812-bcfd-ad91ad81ad15 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:22.815564 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33e633-e3b1-4812-bcfd-ad91ad81ad15 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:22.848346 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedff29f-83a1-4ddc-9d58-0d56a8927bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:22.848897 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedff29f-83a1-4ddc-9d58-0d56a8927bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:22.849170 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedff29f-83a1-4ddc-9d58-0d56a8927bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:22.849472 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedff29f-83a1-4ddc-9d58-0d56a8927bc2 None admin] PATH_INFO: `/v3/users/c0f36c69138f4571be7d0f472fafc7ac` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:22.861781 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedff29f-83a1-4ddc-9d58-0d56a8927bc2 None admin] RBAC: Authorizing `identity:get_user(user_id=c0f36c69138f4571be7d0f472fafc7ac)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:22.863219 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedff29f-83a1-4ddc-9d58-0d56a8927bc2 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:22.864768 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 427/847] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:44:22 2022] GET /identity/v3/users/c0f36c69138f4571be7d0f472fafc7ac => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:22.870806 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec5b46-7a8c-438a-b24e-d7dfb210c719 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:22.915652 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:22.966856 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec5b46-7a8c-438a-b24e-d7dfb210c719 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:22.998715 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb861a-2045-4dee-b276-c7055cf522e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:22.999311 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb861a-2045-4dee-b276-c7055cf522e6 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:22.999584 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb861a-2045-4dee-b276-c7055cf522e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:22.999849 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb861a-2045-4dee-b276-c7055cf522e6 None admin] PATH_INFO: `/v3/projects/72663129724340e39541912b3e5150d3` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:23.000924 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb861a-2045-4dee-b276-c7055cf522e6 None admin] RBAC: Authorizing `identity:get_project(project_id=72663129724340e39541912b3e5150d3)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:23.002355 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb861a-2045-4dee-b276-c7055cf522e6 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:23.003927 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 421/848] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Oct 30 00:44:22 2022] GET /identity/v3/projects/72663129724340e39541912b3e5150d3 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:23.009738 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedff29f-83a1-4ddc-9d58-0d56a8927bc2 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:23.033579 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:23.106114 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedff29f-83a1-4ddc-9d58-0d56a8927bc2 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:23.137939 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b3b13-9475-4821-9322-afa5032665e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:23.138569 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b3b13-9475-4821-9322-afa5032665e1 None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:23.138846 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b3b13-9475-4821-9322-afa5032665e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:23.139113 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b3b13-9475-4821-9322-afa5032665e1 None admin] PATH_INFO: `/v3/projects/72663129724340e39541912b3e5150d3/users/c0f36c69138f4571be7d0f472fafc7ac/roles/b63857cb2ff04d189523309091368e81` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:23.141229 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b3b13-9475-4821-9322-afa5032665e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=72663129724340e39541912b3e5150d3, user_id=c0f36c69138f4571be7d0f472fafc7ac, role_id=b63857cb2ff04d189523309091368e81)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:23.142645 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b3b13-9475-4821-9322-afa5032665e1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:23.155266 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 428/849] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Oct 30 00:44:23 2022] PUT /identity/v3/projects/72663129724340e39541912b3e5150d3/users/c0f36c69138f4571be7d0f472fafc7ac/roles/b63857cb2ff04d189523309091368e81 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:44:25.269364 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69492e1-7168-4f7c-b715-2382a0f5c22b None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:25.269836 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69492e1-7168-4f7c-b715-2382a0f5c22b None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:25.269926 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69492e1-7168-4f7c-b715-2382a0f5c22b None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:25.271240 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 422/850] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:44:25.277105 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaad82-8486-42c2-9247-5ce2cf9b04e8 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:25.277574 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaad82-8486-42c2-9247-5ce2cf9b04e8 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:25.277674 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaad82-8486-42c2-9247-5ce2cf9b04e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:25.295365 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-9aaaad82-8486-42c2-9247-5ce2cf9b04e8 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:44:25.296540 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9aaaad82-8486-42c2-9247-5ce2cf9b04e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:25.360746 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 429/851] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:44:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:44:25.630877 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69492e1-7168-4f7c-b715-2382a0f5c22b None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:25.727838 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69492e1-7168-4f7c-b715-2382a0f5c22b None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:25.741480 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:25.761721 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f744bb-f145-4be3-969b-e206a2df98c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:25.762333 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f744bb-f145-4be3-969b-e206a2df98c0 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:25.762608 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f744bb-f145-4be3-969b-e206a2df98c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:25.762877 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f744bb-f145-4be3-969b-e206a2df98c0 None admin] PATH_INFO: `/v3/roles/b63857cb2ff04d189523309091368e81` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:25.764234 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f744bb-f145-4be3-969b-e206a2df98c0 None admin] RBAC: Authorizing `identity:get_role(role_id=b63857cb2ff04d189523309091368e81)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:25.765623 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f744bb-f145-4be3-969b-e206a2df98c0 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:25.766927 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 423/852] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:44:25 2022] GET /identity/v3/roles/b63857cb2ff04d189523309091368e81 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:25.772733 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaaad82-8486-42c2-9247-5ce2cf9b04e8 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:25.786670 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:25.868500 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaaad82-8486-42c2-9247-5ce2cf9b04e8 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:25.900898 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5410dd2-9f2b-4b17-86a4-c63ea4b11f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:25.901985 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5410dd2-9f2b-4b17-86a4-c63ea4b11f0a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:25.902261 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5410dd2-9f2b-4b17-86a4-c63ea4b11f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:25.902526 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5410dd2-9f2b-4b17-86a4-c63ea4b11f0a None admin] PATH_INFO: `/v3/users/c0f36c69138f4571be7d0f472fafc7ac` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:25.903617 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5410dd2-9f2b-4b17-86a4-c63ea4b11f0a None admin] RBAC: Authorizing `identity:get_user(user_id=c0f36c69138f4571be7d0f472fafc7ac)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:25.905024 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5410dd2-9f2b-4b17-86a4-c63ea4b11f0a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:25.906594 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 430/853] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:44:25 2022] GET /identity/v3/users/c0f36c69138f4571be7d0f472fafc7ac => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:25.912188 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f744bb-f145-4be3-969b-e206a2df98c0 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:26.007765 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f744bb-f145-4be3-969b-e206a2df98c0 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:26.040014 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88fd25-a81c-487c-9b64-5e8dd2adaaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:26.040587 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88fd25-a81c-487c-9b64-5e8dd2adaaa4 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:26.040861 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88fd25-a81c-487c-9b64-5e8dd2adaaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:26.041127 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88fd25-a81c-487c-9b64-5e8dd2adaaa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:26.087270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:26.107363 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88fd25-a81c-487c-9b64-5e8dd2adaaa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:26.108773 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88fd25-a81c-487c-9b64-5e8dd2adaaa4 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:26.202230 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 424/854] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Oct 30 00:44:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 30 00:44:26.208180 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5410dd2-9f2b-4b17-86a4-c63ea4b11f0a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:26.286133 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:26.304538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5410dd2-9f2b-4b17-86a4-c63ea4b11f0a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:26.337518 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7c123-c6d8-4d60-b9da-5559671a03b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:26.338120 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7c123-c6d8-4d60-b9da-5559671a03b7 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:26.338393 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7c123-c6d8-4d60-b9da-5559671a03b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:26.338696 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7c123-c6d8-4d60-b9da-5559671a03b7 None admin] PATH_INFO: `/v3/projects/72663129724340e39541912b3e5150d3` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:26.339775 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7c123-c6d8-4d60-b9da-5559671a03b7 None admin] RBAC: Authorizing `identity:get_project(project_id=72663129724340e39541912b3e5150d3)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:26.341351 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7c123-c6d8-4d60-b9da-5559671a03b7 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:26.342942 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 431/855] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Oct 30 00:44:26 2022] GET /identity/v3/projects/72663129724340e39541912b3e5150d3 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:26.349115 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88fd25-a81c-487c-9b64-5e8dd2adaaa4 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:26.540553 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:26.559475 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88fd25-a81c-487c-9b64-5e8dd2adaaa4 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:26.590418 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a8305-9728-4d6c-ae89-0825aeddacac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:26.590984 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a8305-9728-4d6c-ae89-0825aeddacac None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:26.591253 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a8305-9728-4d6c-ae89-0825aeddacac None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:26.591513 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a8305-9728-4d6c-ae89-0825aeddacac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:26.592209 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a8305-9728-4d6c-ae89-0825aeddacac None admin] RBAC: Adding query filter params (role.id=b63857cb2ff04d189523309091368e81, scope.project.id=72663129724340e39541912b3e5150d3, user.id=c0f36c69138f4571be7d0f472fafc7ac) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:26.592501 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a8305-9728-4d6c-ae89-0825aeddacac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:26.593920 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a8305-9728-4d6c-ae89-0825aeddacac None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:26.599340 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 425/856] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Oct 30 00:44:26 2022] GET /identity/v3/role_assignments?user.id=c0f36c69138f4571be7d0f472fafc7ac&scope.project.id=72663129724340e39541912b3e5150d3&role.id=b63857cb2ff04d189523309091368e81 => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:28.714186 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30553505-77e5-486b-a254-c42dc0035f89 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:28.714650 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30553505-77e5-486b-a254-c42dc0035f89 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:28.714737 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30553505-77e5-486b-a254-c42dc0035f89 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:28.716049 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 432/857] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:44:28.721266 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d78fb-e2da-4b2a-94a5-8c94186856a1 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:28.721680 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d78fb-e2da-4b2a-94a5-8c94186856a1 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:28.721797 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d78fb-e2da-4b2a-94a5-8c94186856a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:28.739660 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-a02d78fb-e2da-4b2a-94a5-8c94186856a1 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:44:28.740827 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a02d78fb-e2da-4b2a-94a5-8c94186856a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:28.804655 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 426/858] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:44:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:44:29.068827 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30553505-77e5-486b-a254-c42dc0035f89 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:29.280009 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30553505-77e5-486b-a254-c42dc0035f89 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:29.312726 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e87f01-025b-48be-a1af-80db52680d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:29.313348 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e87f01-025b-48be-a1af-80db52680d3c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:29.313621 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e87f01-025b-48be-a1af-80db52680d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:29.313885 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e87f01-025b-48be-a1af-80db52680d3c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:29.314965 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e87f01-025b-48be-a1af-80db52680d3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:29.316353 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e87f01-025b-48be-a1af-80db52680d3c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:29.317904 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 433/859] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:44:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:29.323964 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d78fb-e2da-4b2a-94a5-8c94186856a1 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:29.395617 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:29.418173 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d78fb-e2da-4b2a-94a5-8c94186856a1 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:29.450472 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c0385-7c99-44db-9a29-4b3e4aec1515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:29.451054 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c0385-7c99-44db-9a29-4b3e4aec1515 None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:29.451325 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c0385-7c99-44db-9a29-4b3e4aec1515 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:29.451588 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c0385-7c99-44db-9a29-4b3e4aec1515 None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:29.452215 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c0385-7c99-44db-9a29-4b3e4aec1515 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:29.453643 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c0385-7c99-44db-9a29-4b3e4aec1515 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:29.478027 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 427/860] 10.222.0.40 () {60 vars in 1141 bytes} [Sun Oct 30 00:44:29 2022] POST /identity/v3/projects => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:44:31.635008 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee019da0-b1e4-4572-a51f-0b9114eca7ac None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:31.635579 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee019da0-b1e4-4572-a51f-0b9114eca7ac None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:31.635579 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee019da0-b1e4-4572-a51f-0b9114eca7ac None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:31.636860 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 434/861] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:44:31.642015 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4fae3-e6e6-46af-a910-5857f62eff4d None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:31.642381 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4fae3-e6e6-46af-a910-5857f62eff4d None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:31.642562 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4fae3-e6e6-46af-a910-5857f62eff4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:31.660402 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-60e4fae3-e6e6-46af-a910-5857f62eff4d None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:44:31.661602 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-60e4fae3-e6e6-46af-a910-5857f62eff4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:31.725276 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 428/862] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:44:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:44:31.993117 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee019da0-b1e4-4572-a51f-0b9114eca7ac None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:32.011572 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:32.091096 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee019da0-b1e4-4572-a51f-0b9114eca7ac None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:32.123195 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a92c3-a430-4eee-a0a2-807cb4442d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:32.123792 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a92c3-a430-4eee-a0a2-807cb4442d06 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:32.124066 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a92c3-a430-4eee-a0a2-807cb4442d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:32.124333 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a92c3-a430-4eee-a0a2-807cb4442d06 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:32.125436 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a92c3-a430-4eee-a0a2-807cb4442d06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:32.126843 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a92c3-a430-4eee-a0a2-807cb4442d06 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:32.128354 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 435/863] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:44:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:32.134065 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4fae3-e6e6-46af-a910-5857f62eff4d None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:32.189157 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:32.230150 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4fae3-e6e6-46af-a910-5857f62eff4d None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:32.262011 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36d074-eaed-4fed-8a5b-2c122444a23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:32.262589 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36d074-eaed-4fed-8a5b-2c122444a23d None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:32.262865 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36d074-eaed-4fed-8a5b-2c122444a23d None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:32.263128 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36d074-eaed-4fed-8a5b-2c122444a23d None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:32.263753 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36d074-eaed-4fed-8a5b-2c122444a23d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:32.265160 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36d074-eaed-4fed-8a5b-2c122444a23d None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:32.286914 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 429/864] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Oct 30 00:44:32 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:44:34.408574 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf5675-2959-47b4-a3d6-8e108f772fb2 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:34.409164 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf5675-2959-47b4-a3d6-8e108f772fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:34.409164 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf5675-2959-47b4-a3d6-8e108f772fb2 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:34.410465 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 436/865] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:44:34.415458 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da9e8e-ec4f-4eae-ba56-87d5898e9e75 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:34.415825 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da9e8e-ec4f-4eae-ba56-87d5898e9e75 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:34.415997 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da9e8e-ec4f-4eae-ba56-87d5898e9e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:34.434015 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-89da9e8e-ec4f-4eae-ba56-87d5898e9e75 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:44:34.435172 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-89da9e8e-ec4f-4eae-ba56-87d5898e9e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:34.498559 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 430/866] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:44:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:44:34.762934 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf5675-2959-47b4-a3d6-8e108f772fb2 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:34.843941 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:34.860756 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf5675-2959-47b4-a3d6-8e108f772fb2 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:34.892761 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585e8d8-8a50-4aae-99b1-001a0fcbfcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:34.893379 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585e8d8-8a50-4aae-99b1-001a0fcbfcec None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:34.893651 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585e8d8-8a50-4aae-99b1-001a0fcbfcec None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:34.893916 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585e8d8-8a50-4aae-99b1-001a0fcbfcec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:34.904258 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585e8d8-8a50-4aae-99b1-001a0fcbfcec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:44:34.908863 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-c585e8d8-8a50-4aae-99b1-001a0fcbfcec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:44:34.908863 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:34.908863 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:44:34.908863 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:44:34.908863 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:44:34.908863 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:44:34.908863 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:44:34.908863 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:44:34.908863 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:44:34.908863 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:44:34.908863 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:44:34.908863 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:44:34.908863 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:44:34.908863 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:44:34.908863 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:44:34.908863 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:44:34.909977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:44:34.909977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:44:34.909977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:44:34.909977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:44:34.909977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:44:34.909977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:44:34.909977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:44:34.909977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:44:34.909977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:44:34.909977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:44:34.909977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:44:34.909977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:44:34.909977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:44:34.909977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:44:34.909977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:44:34.909977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:44:34.910966 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:44:34.910966 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:44:34.910966 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:44:34.910966 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:44:34.910966 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:44:34.910966 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:44:34.910966 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:44:34.910966 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:44:34.910966 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:44:34.910966 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:44:34.910966 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:44:34.910966 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:44:34.910966 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 437/867] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Oct 30 00:44:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:44:34.915820 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da9e8e-ec4f-4eae-ba56-87d5898e9e75 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:34.959188 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:35.010673 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da9e8e-ec4f-4eae-ba56-87d5898e9e75 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:35.043511 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e6acc-6f83-4e0e-875a-6c350f0aeb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:35.044082 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e6acc-6f83-4e0e-875a-6c350f0aeb01 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:35.044350 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e6acc-6f83-4e0e-875a-6c350f0aeb01 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:35.044614 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e6acc-6f83-4e0e-875a-6c350f0aeb01 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:35.045277 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e6acc-6f83-4e0e-875a-6c350f0aeb01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:35.045569 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e6acc-6f83-4e0e-875a-6c350f0aeb01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:35.046906 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e6acc-6f83-4e0e-875a-6c350f0aeb01 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:35.054409 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 431/868] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:44:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:44:35.060615 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585e8d8-8a50-4aae-99b1-001a0fcbfcec None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:35.154722 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585e8d8-8a50-4aae-99b1-001a0fcbfcec None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:35.186712 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d30cc3-86f3-473f-a62a-c39c4385650d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:35.187300 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d30cc3-86f3-473f-a62a-c39c4385650d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:35.187572 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d30cc3-86f3-473f-a62a-c39c4385650d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:35.187837 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d30cc3-86f3-473f-a62a-c39c4385650d None admin] PATH_INFO: `/v3/users/ea78135843b54254857accd3e9a97102` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:35.200143 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d30cc3-86f3-473f-a62a-c39c4385650d None admin] RBAC: Authorizing `identity:get_user(user_id=ea78135843b54254857accd3e9a97102)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:35.201573 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d30cc3-86f3-473f-a62a-c39c4385650d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:35.203088 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 438/869] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:44:35 2022] GET /identity/v3/users/ea78135843b54254857accd3e9a97102 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:35.208554 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e6acc-6f83-4e0e-875a-6c350f0aeb01 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:35.304423 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e6acc-6f83-4e0e-875a-6c350f0aeb01 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:35.311014 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:35.336877 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa539e-e305-4421-a636-3cc91b7f7262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:35.337511 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa539e-e305-4421-a636-3cc91b7f7262 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:35.337783 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa539e-e305-4421-a636-3cc91b7f7262 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:35.338046 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa539e-e305-4421-a636-3cc91b7f7262 None admin] PATH_INFO: `/v3/projects/6bffdfb1c6334e878dd5f4ec87fa5b53` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:35.339676 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa539e-e305-4421-a636-3cc91b7f7262 None admin] RBAC: Authorizing `identity:get_project(project_id=6bffdfb1c6334e878dd5f4ec87fa5b53)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:35.341079 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa539e-e305-4421-a636-3cc91b7f7262 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:35.342699 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 432/870] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Oct 30 00:44:35 2022] GET /identity/v3/projects/6bffdfb1c6334e878dd5f4ec87fa5b53 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:44:35.348743 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d30cc3-86f3-473f-a62a-c39c4385650d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:35.351588 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:35.442924 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d30cc3-86f3-473f-a62a-c39c4385650d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:35.476275 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2b921-fb14-4a0c-a993-cf32ac2d9f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:35.476930 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2b921-fb14-4a0c-a993-cf32ac2d9f7c None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:35.477258 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2b921-fb14-4a0c-a993-cf32ac2d9f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:35.477536 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2b921-fb14-4a0c-a993-cf32ac2d9f7c None admin] PATH_INFO: `/v3/projects/6bffdfb1c6334e878dd5f4ec87fa5b53/users/ea78135843b54254857accd3e9a97102/roles/17d0330d6df84d3091d7ef234dfc4e6b` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:35.479527 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2b921-fb14-4a0c-a993-cf32ac2d9f7c None admin] RBAC: Authorizing `identity:create_grant(project_id=6bffdfb1c6334e878dd5f4ec87fa5b53, user_id=ea78135843b54254857accd3e9a97102, role_id=17d0330d6df84d3091d7ef234dfc4e6b)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:35.480943 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2b921-fb14-4a0c-a993-cf32ac2d9f7c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:35.492907 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 439/871] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Oct 30 00:44:35 2022] PUT /identity/v3/projects/6bffdfb1c6334e878dd5f4ec87fa5b53/users/ea78135843b54254857accd3e9a97102/roles/17d0330d6df84d3091d7ef234dfc4e6b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:44:37.588055 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea84eb-a2f4-400a-934d-5a5fa7c956f3 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:37.589167 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea84eb-a2f4-400a-934d-5a5fa7c956f3 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:37.589167 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea84eb-a2f4-400a-934d-5a5fa7c956f3 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:37.590564 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 433/872] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:44:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:44:37.595780 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27e653-7500-4a57-bfe5-6e349efde3e6 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:37.596174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27e653-7500-4a57-bfe5-6e349efde3e6 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:37.596315 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27e653-7500-4a57-bfe5-6e349efde3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:37.613667 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-ed27e653-7500-4a57-bfe5-6e349efde3e6 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:44:37.614825 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ed27e653-7500-4a57-bfe5-6e349efde3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:37.668302 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:37.679194 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 440/873] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:44:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:44:37.943968 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea84eb-a2f4-400a-934d-5a5fa7c956f3 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:38.041205 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea84eb-a2f4-400a-934d-5a5fa7c956f3 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:38.073411 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212502a-0e07-444f-8600-db78cf08f13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:38.074011 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212502a-0e07-444f-8600-db78cf08f13e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:38.074286 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212502a-0e07-444f-8600-db78cf08f13e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:38.074555 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212502a-0e07-444f-8600-db78cf08f13e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:38.084512 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212502a-0e07-444f-8600-db78cf08f13e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:44:38.089233 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-e212502a-0e07-444f-8600-db78cf08f13e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:44:38.089233 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:38.089233 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:44:38.089233 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:44:38.089233 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:44:38.089233 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:44:38.089233 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:44:38.089233 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:44:38.089233 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:44:38.089233 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:44:38.089233 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:44:38.089233 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:44:38.089233 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:44:38.089233 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:44:38.089233 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:44:38.089233 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:44:38.090307 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:44:38.090307 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:44:38.090307 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:44:38.090307 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:44:38.090307 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:44:38.090307 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:44:38.090307 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:44:38.090307 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:44:38.090307 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:44:38.090307 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:44:38.090307 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:44:38.090307 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:44:38.090307 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:44:38.090307 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:44:38.090307 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:44:38.090307 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:44:38.091285 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:44:38.091285 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:44:38.091285 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:44:38.091285 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:44:38.091285 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:44:38.091285 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:44:38.091285 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:44:38.091285 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:44:38.091285 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:44:38.091285 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:44:38.091285 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:44:38.091285 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:44:38.091285 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 434/874] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Oct 30 00:44:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:44:38.096046 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27e653-7500-4a57-bfe5-6e349efde3e6 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:38.189384 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27e653-7500-4a57-bfe5-6e349efde3e6 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:38.221375 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3975a-9c8e-48fd-bda8-fc94c544ba21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:38.221904 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3975a-9c8e-48fd-bda8-fc94c544ba21 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:38.222174 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3975a-9c8e-48fd-bda8-fc94c544ba21 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:38.222436 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3975a-9c8e-48fd-bda8-fc94c544ba21 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:38.223074 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab3975a-9c8e-48fd-bda8-fc94c544ba21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:38.223365 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab3975a-9c8e-48fd-bda8-fc94c544ba21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:38.224700 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab3975a-9c8e-48fd-bda8-fc94c544ba21 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:38.232787 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 441/875] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:44:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:38.238655 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212502a-0e07-444f-8600-db78cf08f13e None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:38.272049 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:38.336361 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212502a-0e07-444f-8600-db78cf08f13e None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:38.368249 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca58d04-0d85-4cd8-9032-7160a9dfd052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:38.368859 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca58d04-0d85-4cd8-9032-7160a9dfd052 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:38.369134 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca58d04-0d85-4cd8-9032-7160a9dfd052 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:38.369431 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca58d04-0d85-4cd8-9032-7160a9dfd052 None admin] PATH_INFO: `/v3/users/ea78135843b54254857accd3e9a97102` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:38.371050 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca58d04-0d85-4cd8-9032-7160a9dfd052 None admin] RBAC: Authorizing `identity:get_user(user_id=ea78135843b54254857accd3e9a97102)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:38.372469 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca58d04-0d85-4cd8-9032-7160a9dfd052 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:38.374075 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 435/876] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:44:38 2022] GET /identity/v3/users/ea78135843b54254857accd3e9a97102 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:38.379745 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3975a-9c8e-48fd-bda8-fc94c544ba21 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:38.432649 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:38.474678 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3975a-9c8e-48fd-bda8-fc94c544ba21 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:38.506946 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b4348-1c30-4062-9dbb-b8ab17b2f501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:38.507527 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b4348-1c30-4062-9dbb-b8ab17b2f501 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:38.507800 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b4348-1c30-4062-9dbb-b8ab17b2f501 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:38.508066 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b4348-1c30-4062-9dbb-b8ab17b2f501 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:38.571145 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b4348-1c30-4062-9dbb-b8ab17b2f501 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:38.572555 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b4348-1c30-4062-9dbb-b8ab17b2f501 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:38.622759 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:38.665694 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 442/877] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Oct 30 00:44:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 30 00:44:38.672025 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca58d04-0d85-4cd8-9032-7160a9dfd052 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:38.766355 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca58d04-0d85-4cd8-9032-7160a9dfd052 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:38.767806 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:38.799424 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebfde1-4e16-442f-8388-8a88e502b834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:38.800017 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebfde1-4e16-442f-8388-8a88e502b834 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:38.800287 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebfde1-4e16-442f-8388-8a88e502b834 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:38.800552 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebfde1-4e16-442f-8388-8a88e502b834 None admin] PATH_INFO: `/v3/projects/6bffdfb1c6334e878dd5f4ec87fa5b53` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:38.801643 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebfde1-4e16-442f-8388-8a88e502b834 None admin] RBAC: Authorizing `identity:get_project(project_id=6bffdfb1c6334e878dd5f4ec87fa5b53)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:38.803041 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebfde1-4e16-442f-8388-8a88e502b834 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:38.804618 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 436/878] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Oct 30 00:44:38 2022] GET /identity/v3/projects/6bffdfb1c6334e878dd5f4ec87fa5b53 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:38.811178 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b4348-1c30-4062-9dbb-b8ab17b2f501 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:38.904775 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b4348-1c30-4062-9dbb-b8ab17b2f501 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:38.936760 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5ed24-ace3-4bfa-8683-1ce709f4c1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:38.937356 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5ed24-ace3-4bfa-8683-1ce709f4c1fc None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:38.937629 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5ed24-ace3-4bfa-8683-1ce709f4c1fc None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:38.937892 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5ed24-ace3-4bfa-8683-1ce709f4c1fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:38.938590 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5ed24-ace3-4bfa-8683-1ce709f4c1fc None admin] RBAC: Adding query filter params (role.id=17d0330d6df84d3091d7ef234dfc4e6b, scope.project.id=6bffdfb1c6334e878dd5f4ec87fa5b53, user.id=ea78135843b54254857accd3e9a97102) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:38.938887 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5ed24-ace3-4bfa-8683-1ce709f4c1fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:38.940284 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5ed24-ace3-4bfa-8683-1ce709f4c1fc None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:38.945738 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 443/879] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Oct 30 00:44:38 2022] GET /identity/v3/role_assignments?user.id=ea78135843b54254857accd3e9a97102&scope.project.id=6bffdfb1c6334e878dd5f4ec87fa5b53&role.id=17d0330d6df84d3091d7ef234dfc4e6b => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:41.065283 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51a4ff-c781-46cd-b06b-b9ea2cb705a0 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:41.065817 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51a4ff-c781-46cd-b06b-b9ea2cb705a0 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:41.065817 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51a4ff-c781-46cd-b06b-b9ea2cb705a0 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:41.067147 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 437/880] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:44:41.072440 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ec7b0-7973-4959-89a7-963a6169d566 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:41.073402 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ec7b0-7973-4959-89a7-963a6169d566 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:41.073618 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ec7b0-7973-4959-89a7-963a6169d566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:41.091736 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-c90ec7b0-7973-4959-89a7-963a6169d566 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:44:41.092907 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c90ec7b0-7973-4959-89a7-963a6169d566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:41.105532 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:41.157802 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 444/881] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:44:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:44:41.425787 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51a4ff-c781-46cd-b06b-b9ea2cb705a0 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:41.522844 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51a4ff-c781-46cd-b06b-b9ea2cb705a0 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:41.555265 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72212e-9d03-4b14-9b57-200685e0afe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:41.555829 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72212e-9d03-4b14-9b57-200685e0afe6 None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:41.556098 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72212e-9d03-4b14-9b57-200685e0afe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:41.556361 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72212e-9d03-4b14-9b57-200685e0afe6 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:41.557590 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72212e-9d03-4b14-9b57-200685e0afe6 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:41.558923 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72212e-9d03-4b14-9b57-200685e0afe6 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:41.573798 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 438/882] 10.222.0.40 () {60 vars in 1138 bytes} [Sun Oct 30 00:44:41 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:44:43.699354 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171ce57-74b0-4bfe-9b45-213ca3aeb890 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:43.699817 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171ce57-74b0-4bfe-9b45-213ca3aeb890 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:43.699924 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171ce57-74b0-4bfe-9b45-213ca3aeb890 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:43.701212 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 445/883] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:44:43.706470 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e881408-5528-46eb-ae44-8545cf5555bd None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:43.706901 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e881408-5528-46eb-ae44-8545cf5555bd None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:43.707001 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e881408-5528-46eb-ae44-8545cf5555bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:43.724977 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-2e881408-5528-46eb-ae44-8545cf5555bd None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:44:43.726188 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-2e881408-5528-46eb-ae44-8545cf5555bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:43.748258 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:43.790573 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 439/884] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:44:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:44:44.058429 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171ce57-74b0-4bfe-9b45-213ca3aeb890 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:44.155093 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171ce57-74b0-4bfe-9b45-213ca3aeb890 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:44.187089 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f23789-a2b9-41d3-a441-c3c3f7c03baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:44.187688 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f23789-a2b9-41d3-a441-c3c3f7c03baf None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:44.187960 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f23789-a2b9-41d3-a441-c3c3f7c03baf None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:44.188223 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f23789-a2b9-41d3-a441-c3c3f7c03baf None admin] PATH_INFO: `/v3/domains/dad57f35b92648549fca133e006f40b6` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:44.198633 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f23789-a2b9-41d3-a441-c3c3f7c03baf None admin] RBAC: Authorizing `identity:get_domain(domain_id=dad57f35b92648549fca133e006f40b6)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:44.200048 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f23789-a2b9-41d3-a441-c3c3f7c03baf None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:44.201617 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 446/885] 10.222.0.40 () {56 vars in 1183 bytes} [Sun Oct 30 00:44:44 2022] GET /identity/v3/domains/dad57f35b92648549fca133e006f40b6 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:44.207231 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e881408-5528-46eb-ae44-8545cf5555bd None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:44.302597 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e881408-5528-46eb-ae44-8545cf5555bd None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:44.334859 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1282377-dd22-4f5b-8d79-f862ba7393ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:44.335385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1282377-dd22-4f5b-8d79-f862ba7393ef None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:44.335656 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1282377-dd22-4f5b-8d79-f862ba7393ef None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:44.335982 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1282377-dd22-4f5b-8d79-f862ba7393ef None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:44.336565 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1282377-dd22-4f5b-8d79-f862ba7393ef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:44.338002 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1282377-dd22-4f5b-8d79-f862ba7393ef None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:44.363469 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 440/886] 10.222.0.40 () {60 vars in 1141 bytes} [Sun Oct 30 00:44:44 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:44:46.499673 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2926ad5-b8a6-4f06-995b-bb5338855f56 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:46.500221 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2926ad5-b8a6-4f06-995b-bb5338855f56 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:46.500221 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2926ad5-b8a6-4f06-995b-bb5338855f56 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:46.501594 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 447/887] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:44:46.506663 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666a2b1-1219-4470-9fe6-0e92b0300b27 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:46.507098 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666a2b1-1219-4470-9fe6-0e92b0300b27 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:46.507196 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666a2b1-1219-4470-9fe6-0e92b0300b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:46.525436 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-7666a2b1-1219-4470-9fe6-0e92b0300b27 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:44:46.527228 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-7666a2b1-1219-4470-9fe6-0e92b0300b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:46.534272 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:46.591399 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 441/888] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:44:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:44:46.854989 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2926ad5-b8a6-4f06-995b-bb5338855f56 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:46.866195 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:46.953857 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2926ad5-b8a6-4f06-995b-bb5338855f56 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:46.985451 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29502616-74b6-4b60-a30f-88f5ecca4076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:46.986056 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29502616-74b6-4b60-a30f-88f5ecca4076 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:46.986330 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29502616-74b6-4b60-a30f-88f5ecca4076 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:46.986597 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29502616-74b6-4b60-a30f-88f5ecca4076 None admin] PATH_INFO: `/v3/domains/dad57f35b92648549fca133e006f40b6` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:46.987690 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29502616-74b6-4b60-a30f-88f5ecca4076 None admin] RBAC: Authorizing `identity:get_domain(domain_id=dad57f35b92648549fca133e006f40b6)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:46.989096 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29502616-74b6-4b60-a30f-88f5ecca4076 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:46.990644 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 448/889] 10.222.0.40 () {56 vars in 1183 bytes} [Sun Oct 30 00:44:46 2022] GET /identity/v3/domains/dad57f35b92648549fca133e006f40b6 => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:46.996744 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666a2b1-1219-4470-9fe6-0e92b0300b27 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:47.090916 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666a2b1-1219-4470-9fe6-0e92b0300b27 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:47.123184 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05321be-de8d-4420-bdc2-99ffceb6060d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:47.123706 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05321be-de8d-4420-bdc2-99ffceb6060d None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:47.123980 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05321be-de8d-4420-bdc2-99ffceb6060d None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:47.124247 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05321be-de8d-4420-bdc2-99ffceb6060d None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:47.124876 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05321be-de8d-4420-bdc2-99ffceb6060d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:47.126382 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05321be-de8d-4420-bdc2-99ffceb6060d None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:47.141488 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:47.147596 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 442/890] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Oct 30 00:44:46 2022] POST /identity/v3/users => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:44:49.311790 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c6310-353c-426d-8f14-1528faf492ef None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:49.312343 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c6310-353c-426d-8f14-1528faf492ef None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:49.312343 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c6310-353c-426d-8f14-1528faf492ef None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:49.313689 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 449/891] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:44:49.318766 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6b5e8-374a-4fee-9ad2-79edc0de91b7 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:49.319195 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6b5e8-374a-4fee-9ad2-79edc0de91b7 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:49.319294 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6b5e8-374a-4fee-9ad2-79edc0de91b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:49.337438 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-63b6b5e8-374a-4fee-9ad2-79edc0de91b7 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:44:49.338605 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-63b6b5e8-374a-4fee-9ad2-79edc0de91b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:49.411170 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 443/892] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:44:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:44:49.686491 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c6310-353c-426d-8f14-1528faf492ef None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:49.760726 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:49.783699 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c6310-353c-426d-8f14-1528faf492ef None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:49.815678 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eff6e9-f06c-44b8-9a10-1954fee8ea15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:49.816275 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eff6e9-f06c-44b8-9a10-1954fee8ea15 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:49.816547 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eff6e9-f06c-44b8-9a10-1954fee8ea15 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:49.816812 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eff6e9-f06c-44b8-9a10-1954fee8ea15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:49.827321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eff6e9-f06c-44b8-9a10-1954fee8ea15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:44:49.831949 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-57eff6e9-f06c-44b8-9a10-1954fee8ea15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:44:49.831949 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:49.831949 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:44:49.831949 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:44:49.831949 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:44:49.831949 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:44:49.831949 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:44:49.831949 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:44:49.831949 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:44:49.831949 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:44:49.831949 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:44:49.831949 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:44:49.831949 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:44:49.831949 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:44:49.831949 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:44:49.831949 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:44:49.833092 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:44:49.833092 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:44:49.833092 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:44:49.833092 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:44:49.833092 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:44:49.833092 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:44:49.833092 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:44:49.833092 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:44:49.833092 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:44:49.833092 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:44:49.833092 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:44:49.833092 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:44:49.833092 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:44:49.833092 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:44:49.833092 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:44:49.833092 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:44:49.834296 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:44:49.834296 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:44:49.834296 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:44:49.834296 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:44:49.834296 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:44:49.834296 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:44:49.834296 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:44:49.834296 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:44:49.834296 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:44:49.834296 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:44:49.834296 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:44:49.834296 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:44:49.834296 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 450/893] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Oct 30 00:44:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:44:49.839533 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6b5e8-374a-4fee-9ad2-79edc0de91b7 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:49.933472 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6b5e8-374a-4fee-9ad2-79edc0de91b7 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:49.959028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:49.966860 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e075759-379d-4837-b209-96f2cb73e1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:49.967437 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e075759-379d-4837-b209-96f2cb73e1bb None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:49.967708 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e075759-379d-4837-b209-96f2cb73e1bb None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:49.967972 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e075759-379d-4837-b209-96f2cb73e1bb None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:49.968612 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e075759-379d-4837-b209-96f2cb73e1bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:49.968904 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e075759-379d-4837-b209-96f2cb73e1bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:49.970279 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e075759-379d-4837-b209-96f2cb73e1bb None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:49.977906 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 444/894] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:44:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:49.983523 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eff6e9-f06c-44b8-9a10-1954fee8ea15 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:50.079587 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eff6e9-f06c-44b8-9a10-1954fee8ea15 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:50.110913 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab723f-9375-4a3e-a167-86b721fe8867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:50.111513 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab723f-9375-4a3e-a167-86b721fe8867 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:50.111785 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab723f-9375-4a3e-a167-86b721fe8867 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:50.112051 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab723f-9375-4a3e-a167-86b721fe8867 None admin] PATH_INFO: `/v3/users/8ec0cb83bd324f6b91b6f953de70bb1a` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:50.114590 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:50.125441 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab723f-9375-4a3e-a167-86b721fe8867 None admin] RBAC: Authorizing `identity:get_user(user_id=8ec0cb83bd324f6b91b6f953de70bb1a)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:50.126847 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab723f-9375-4a3e-a167-86b721fe8867 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:50.128385 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 451/895] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:44:49 2022] GET /identity/v3/users/8ec0cb83bd324f6b91b6f953de70bb1a => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:50.134018 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e075759-379d-4837-b209-96f2cb73e1bb None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:50.227794 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e075759-379d-4837-b209-96f2cb73e1bb None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:50.259588 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b0947-712c-4421-b60b-c042477239f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:50.260204 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b0947-712c-4421-b60b-c042477239f2 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:50.260472 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b0947-712c-4421-b60b-c042477239f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:50.260734 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b0947-712c-4421-b60b-c042477239f2 None admin] PATH_INFO: `/v3/projects/f6c115674fb44362b205c03f716d9e2e` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:50.261935 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b0947-712c-4421-b60b-c042477239f2 None admin] RBAC: Authorizing `identity:get_project(project_id=f6c115674fb44362b205c03f716d9e2e)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:50.263351 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b0947-712c-4421-b60b-c042477239f2 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:50.264943 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 445/896] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Oct 30 00:44:50 2022] GET /identity/v3/projects/f6c115674fb44362b205c03f716d9e2e => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:50.270504 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab723f-9375-4a3e-a167-86b721fe8867 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:50.365101 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab723f-9375-4a3e-a167-86b721fe8867 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:50.397785 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940ed0c-d468-4497-9dbd-0686332542d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:50.398414 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940ed0c-d468-4497-9dbd-0686332542d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:50.398689 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940ed0c-d468-4497-9dbd-0686332542d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:50.398955 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940ed0c-d468-4497-9dbd-0686332542d3 None admin] PATH_INFO: `/v3/projects/f6c115674fb44362b205c03f716d9e2e/users/8ec0cb83bd324f6b91b6f953de70bb1a/roles/17d0330d6df84d3091d7ef234dfc4e6b` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:50.401072 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5940ed0c-d468-4497-9dbd-0686332542d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6c115674fb44362b205c03f716d9e2e, user_id=8ec0cb83bd324f6b91b6f953de70bb1a, role_id=17d0330d6df84d3091d7ef234dfc4e6b)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:50.402512 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5940ed0c-d468-4497-9dbd-0686332542d3 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:50.414620 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 452/897] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Oct 30 00:44:50 2022] PUT /identity/v3/projects/f6c115674fb44362b205c03f716d9e2e/users/8ec0cb83bd324f6b91b6f953de70bb1a/roles/17d0330d6df84d3091d7ef234dfc4e6b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:44:52.515569 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e14f0-d7ad-4a44-aeb7-c8b663f1b75a None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:52.516121 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e14f0-d7ad-4a44-aeb7-c8b663f1b75a None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:52.516121 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e14f0-d7ad-4a44-aeb7-c8b663f1b75a None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:52.517594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 446/898] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:44:52.522813 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcb098-b8ed-499b-ad17-a76d6bbbbba2 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:52.523179 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcb098-b8ed-499b-ad17-a76d6bbbbba2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:52.523349 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcb098-b8ed-499b-ad17-a76d6bbbbba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:52.541645 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-8cbcb098-b8ed-499b-ad17-a76d6bbbbba2 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:44:52.542806 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8cbcb098-b8ed-499b-ad17-a76d6bbbbba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:52.590162 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:52.607132 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 453/899] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:44:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:44:52.872416 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e14f0-d7ad-4a44-aeb7-c8b663f1b75a None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:52.928956 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:52.970392 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e14f0-d7ad-4a44-aeb7-c8b663f1b75a None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:53.002078 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ab25e-2a50-4d82-b55d-eb736938a916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:53.002670 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ab25e-2a50-4d82-b55d-eb736938a916 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:53.002939 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ab25e-2a50-4d82-b55d-eb736938a916 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:53.003205 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ab25e-2a50-4d82-b55d-eb736938a916 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:53.013687 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ab25e-2a50-4d82-b55d-eb736938a916 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:44:53.018337 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-a94ab25e-2a50-4d82-b55d-eb736938a916 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:44:53.018337 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:44:53.018337 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:44:53.018337 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:44:53.018337 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:44:53.018337 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:44:53.018337 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:44:53.018337 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:44:53.018337 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:44:53.018337 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:44:53.018337 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:44:53.018337 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:44:53.018337 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:44:53.018337 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:44:53.018337 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:44:53.018337 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:44:53.019442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:44:53.019442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:44:53.019442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:44:53.019442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:44:53.019442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:44:53.019442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:44:53.019442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:44:53.019442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:44:53.019442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:44:53.019442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:44:53.019442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:44:53.019442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:44:53.019442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:44:53.019442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:44:53.019442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:44:53.019442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:44:53.020496 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:44:53.020496 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:44:53.020496 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:44:53.020496 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:44:53.020496 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:44:53.020496 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:44:53.020496 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:44:53.020496 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:44:53.020496 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:44:53.020496 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:44:53.020496 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:44:53.020496 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:44:53.020496 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 447/900] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Oct 30 00:44:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:44:53.025660 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcb098-b8ed-499b-ad17-a76d6bbbbba2 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:53.118185 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcb098-b8ed-499b-ad17-a76d6bbbbba2 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:53.151065 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60a85c-8e2d-48cf-8374-b94f34cdccb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:53.151590 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60a85c-8e2d-48cf-8374-b94f34cdccb1 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:53.151862 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60a85c-8e2d-48cf-8374-b94f34cdccb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:53.152124 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60a85c-8e2d-48cf-8374-b94f34cdccb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:53.152759 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60a85c-8e2d-48cf-8374-b94f34cdccb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:53.153050 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60a85c-8e2d-48cf-8374-b94f34cdccb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:53.154413 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60a85c-8e2d-48cf-8374-b94f34cdccb1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:53.161947 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 454/901] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:44:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:53.167737 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ab25e-2a50-4d82-b55d-eb736938a916 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:53.262975 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ab25e-2a50-4d82-b55d-eb736938a916 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:53.279269 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:53.295966 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ee1f0-df09-414c-8438-5873d47b671c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:53.296570 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ee1f0-df09-414c-8438-5873d47b671c None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:53.296842 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ee1f0-df09-414c-8438-5873d47b671c None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:53.297116 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ee1f0-df09-414c-8438-5873d47b671c None admin] PATH_INFO: `/v3/users/8ec0cb83bd324f6b91b6f953de70bb1a` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:53.298239 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ee1f0-df09-414c-8438-5873d47b671c None admin] RBAC: Authorizing `identity:get_user(user_id=8ec0cb83bd324f6b91b6f953de70bb1a)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:53.299637 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ee1f0-df09-414c-8438-5873d47b671c None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:53.301173 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 448/902] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Oct 30 00:44:53 2022] GET /identity/v3/users/8ec0cb83bd324f6b91b6f953de70bb1a => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:53.307434 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60a85c-8e2d-48cf-8374-b94f34cdccb1 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:53.350905 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:53.402958 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60a85c-8e2d-48cf-8374-b94f34cdccb1 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:53.435285 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bea37a-c6fb-4d87-beb1-51b554e792b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:53.435869 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bea37a-c6fb-4d87-beb1-51b554e792b3 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:53.436145 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bea37a-c6fb-4d87-beb1-51b554e792b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:53.436412 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bea37a-c6fb-4d87-beb1-51b554e792b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:53.499516 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bea37a-c6fb-4d87-beb1-51b554e792b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:53.500928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bea37a-c6fb-4d87-beb1-51b554e792b3 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:53.544230 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:53.595000 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 455/903] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Oct 30 00:44:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 30 00:44:53.600836 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ee1f0-df09-414c-8438-5873d47b671c None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:53.701166 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ee1f0-df09-414c-8438-5873d47b671c None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:53.733778 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3bddd-b4fe-47bb-9f0e-34a5338621ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:53.734390 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3bddd-b4fe-47bb-9f0e-34a5338621ab None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:53.734668 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3bddd-b4fe-47bb-9f0e-34a5338621ab None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:53.734944 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3bddd-b4fe-47bb-9f0e-34a5338621ab None admin] PATH_INFO: `/v3/projects/f6c115674fb44362b205c03f716d9e2e` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:53.736040 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3bddd-b4fe-47bb-9f0e-34a5338621ab None admin] RBAC: Authorizing `identity:get_project(project_id=f6c115674fb44362b205c03f716d9e2e)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:53.737494 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3bddd-b4fe-47bb-9f0e-34a5338621ab None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:53.739095 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 449/904] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Oct 30 00:44:53 2022] GET /identity/v3/projects/f6c115674fb44362b205c03f716d9e2e => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:53.745214 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bea37a-c6fb-4d87-beb1-51b554e792b3 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:53.839189 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bea37a-c6fb-4d87-beb1-51b554e792b3 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:53.872351 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f54006-1e65-45d7-a5c1-8da3a19b9a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:53.872940 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f54006-1e65-45d7-a5c1-8da3a19b9a46 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:53.873239 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f54006-1e65-45d7-a5c1-8da3a19b9a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:53.873511 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f54006-1e65-45d7-a5c1-8da3a19b9a46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:53.874248 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f54006-1e65-45d7-a5c1-8da3a19b9a46 None admin] RBAC: Adding query filter params (role.id=17d0330d6df84d3091d7ef234dfc4e6b, scope.project.id=f6c115674fb44362b205c03f716d9e2e, user.id=8ec0cb83bd324f6b91b6f953de70bb1a) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:53.874550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f54006-1e65-45d7-a5c1-8da3a19b9a46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:53.875953 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f54006-1e65-45d7-a5c1-8da3a19b9a46 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:53.881484 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 456/905] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Oct 30 00:44:53 2022] GET /identity/v3/role_assignments?user.id=8ec0cb83bd324f6b91b6f953de70bb1a&scope.project.id=f6c115674fb44362b205c03f716d9e2e&role.id=17d0330d6df84d3091d7ef234dfc4e6b => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:45:03.729316 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=73 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:45:03.878923 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=95 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:45:49.170913 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611282b-81db-43c5-a9e4-07daec1793ea None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:45:49.171501 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611282b-81db-43c5-a9e4-07daec1793ea None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:45:49.171501 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611282b-81db-43c5-a9e4-07daec1793ea None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:45:49.172781 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 450/906] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:45:49.179402 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878b0d0-8068-46ed-b5e7-ec85879cfeba None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:45:49.179880 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878b0d0-8068-46ed-b5e7-ec85879cfeba None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:45:49.179979 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878b0d0-8068-46ed-b5e7-ec85879cfeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:45:49.205714 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-4878b0d0-8068-46ed-b5e7-ec85879cfeba None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:45:49.207012 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4878b0d0-8068-46ed-b5e7-ec85879cfeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:45:49.303737 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 457/907] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:45:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:45:49.602750 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611282b-81db-43c5-a9e4-07daec1793ea None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:45:49.732384 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611282b-81db-43c5-a9e4-07daec1793ea None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:45:49.770890 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5468fa-a7a9-4981-8a1e-d32efdfec50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:45:49.771535 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5468fa-a7a9-4981-8a1e-d32efdfec50e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:45:49.771880 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5468fa-a7a9-4981-8a1e-d32efdfec50e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:45:49.772140 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5468fa-a7a9-4981-8a1e-d32efdfec50e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:45:49.785300 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5468fa-a7a9-4981-8a1e-d32efdfec50e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:45:49.786746 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5468fa-a7a9-4981-8a1e-d32efdfec50e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:45:49.801488 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-4a5468fa-a7a9-4981-8a1e-d32efdfec50e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:45:49.801488 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:45:49.801488 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:45:49.801488 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:45:49.801488 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:45:49.801488 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:45:49.801488 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:45:49.801488 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:45:49.801488 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:45:49.801488 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:45:49.801488 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:45:49.801488 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:45:49.801488 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:45:49.801488 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:45:49.801488 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:45:49.801488 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:45:49.802572 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:45:49.802572 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:45:49.802572 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:45:49.802572 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:45:49.802572 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:45:49.802572 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:45:49.802572 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:45:49.802572 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:45:49.802572 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:45:49.802572 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:45:49.802572 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:45:49.802572 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:45:49.802572 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:45:49.802572 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:45:49.802572 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:45:49.802572 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:45:49.802572 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:45:49.803547 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:45:49.803547 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:45:49.803547 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:45:49.803547 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 451/908] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:45:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:45:49.809079 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878b0d0-8068-46ed-b5e7-ec85879cfeba None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:45:49.932898 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878b0d0-8068-46ed-b5e7-ec85879cfeba None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:45:49.964929 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:45:49.973921 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4690cb3-2912-43fb-8435-9f504034cd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:45:49.974670 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4690cb3-2912-43fb-8435-9f504034cd74 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:45:49.975027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4690cb3-2912-43fb-8435-9f504034cd74 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:45:49.975027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4690cb3-2912-43fb-8435-9f504034cd74 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:45:49.975966 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4690cb3-2912-43fb-8435-9f504034cd74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:45:49.976255 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4690cb3-2912-43fb-8435-9f504034cd74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:45:49.980269 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4690cb3-2912-43fb-8435-9f504034cd74 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:45:49.992648 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 458/909] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:45:49.999809 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5468fa-a7a9-4981-8a1e-d32efdfec50e None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:45:50.062152 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:45:50.132251 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5468fa-a7a9-4981-8a1e-d32efdfec50e None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:45:50.174590 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015ec7f-eb9b-475b-881a-dcf733ebeb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:45:50.175358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015ec7f-eb9b-475b-881a-dcf733ebeb92 None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:45:50.175603 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015ec7f-eb9b-475b-881a-dcf733ebeb92 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:45:50.175827 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015ec7f-eb9b-475b-881a-dcf733ebeb92 None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:45:50.176463 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9015ec7f-eb9b-475b-881a-dcf733ebeb92 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:45:50.177910 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9015ec7f-eb9b-475b-881a-dcf733ebeb92 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:45:50.205535 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 452/910] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Oct 30 00:45:49 2022] POST /identity/v3/users => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:45:52.522919 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7be035-0794-4e04-9814-20d8f7f8ec0d None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:45:52.523486 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7be035-0794-4e04-9814-20d8f7f8ec0d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:45:52.523486 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7be035-0794-4e04-9814-20d8f7f8ec0d None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:45:52.525901 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 459/911] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:45:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:45:52.531211 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0f7f2-c80d-4797-9c45-58bcc22f1585 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:45:52.532559 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0f7f2-c80d-4797-9c45-58bcc22f1585 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:45:52.532559 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0f7f2-c80d-4797-9c45-58bcc22f1585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:45:52.551326 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-2ff0f7f2-c80d-4797-9c45-58bcc22f1585 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:45:52.552597 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-2ff0f7f2-c80d-4797-9c45-58bcc22f1585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:45:52.624339 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 453/912] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:45:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:45:52.889731 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7be035-0794-4e04-9814-20d8f7f8ec0d None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:45:53.003750 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7be035-0794-4e04-9814-20d8f7f8ec0d None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:45:53.045141 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8f3a3-8743-4eb1-8aec-93c1735e53b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:45:53.045984 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8f3a3-8743-4eb1-8aec-93c1735e53b2 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:45:53.046284 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8f3a3-8743-4eb1-8aec-93c1735e53b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:45:53.046555 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8f3a3-8743-4eb1-8aec-93c1735e53b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:45:53.059071 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8f3a3-8743-4eb1-8aec-93c1735e53b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:45:53.063950 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-24e8f3a3-8743-4eb1-8aec-93c1735e53b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:45:53.063950 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:45:53.063950 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:45:53.063950 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:45:53.063950 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:45:53.063950 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:45:53.063950 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:45:53.063950 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:45:53.063950 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:45:53.063950 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:45:53.063950 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:45:53.063950 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:45:53.063950 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:45:53.063950 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:45:53.063950 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:45:53.063950 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:45:53.065148 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:45:53.065148 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:45:53.065148 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:45:53.065148 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:45:53.065148 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:45:53.065148 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:45:53.065148 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:45:53.065148 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:45:53.065148 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:45:53.065148 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:45:53.065148 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:45:53.065148 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:45:53.065148 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:45:53.065148 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:45:53.065148 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:45:53.065148 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:45:53.066154 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:45:53.066154 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:45:53.066154 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:45:53.066154 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:45:53.066154 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:45:53.066154 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:45:53.066154 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:45:53.066154 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:45:53.066154 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:45:53.066154 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:45:53.066154 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:45:53.066154 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:45:53.066154 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 460/913] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Oct 30 00:45:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:45:53.071039 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0f7f2-c80d-4797-9c45-58bcc22f1585 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:45:53.111805 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:45:53.175308 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0f7f2-c80d-4797-9c45-58bcc22f1585 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:45:53.212190 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991d139-26ce-4914-8446-cf7374b57ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:45:53.213040 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991d139-26ce-4914-8446-cf7374b57ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:45:53.213440 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991d139-26ce-4914-8446-cf7374b57ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:45:53.213855 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991d139-26ce-4914-8446-cf7374b57ef6 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:45:53.214563 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991d139-26ce-4914-8446-cf7374b57ef6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:45:53.214884 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991d139-26ce-4914-8446-cf7374b57ef6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:45:53.216480 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991d139-26ce-4914-8446-cf7374b57ef6 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:45:53.226562 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 454/914] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Oct 30 00:45:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:45:53.232917 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8f3a3-8743-4eb1-8aec-93c1735e53b2 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:45:53.289996 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:45:53.357287 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8f3a3-8743-4eb1-8aec-93c1735e53b2 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:45:53.404000 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4d084-7fa8-49a5-820b-11d904afd27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:45:53.404701 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4d084-7fa8-49a5-820b-11d904afd27a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:45:53.405010 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4d084-7fa8-49a5-820b-11d904afd27a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:45:53.405300 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4d084-7fa8-49a5-820b-11d904afd27a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:45:53.416989 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4d084-7fa8-49a5-820b-11d904afd27a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:45:53.418465 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4d084-7fa8-49a5-820b-11d904afd27a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:45:53.435458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-ebf4d084-7fa8-49a5-820b-11d904afd27a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:45:53.435458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:45:53.435458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:45:53.435458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:45:53.435458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:45:53.435458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:45:53.435458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:45:53.435458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:45:53.435458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:45:53.435458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:45:53.435458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:45:53.435458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:45:53.435458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:45:53.435458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:45:53.435458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:45:53.435458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:45:53.436495 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:45:53.436495 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:45:53.436495 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:45:53.436495 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:45:53.436495 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:45:53.436495 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:45:53.436495 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:45:53.436495 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:45:53.436495 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:45:53.436495 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:45:53.436495 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:45:53.436495 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:45:53.436495 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:45:53.436495 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:45:53.436495 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:45:53.436495 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:45:53.436495 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:45:53.437808 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:45:53.437808 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:45:53.437808 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:45:53.437808 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 461/915] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:45:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:45:53.442920 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991d139-26ce-4914-8446-cf7374b57ef6 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:45:53.558341 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:45:53.561731 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991d139-26ce-4914-8446-cf7374b57ef6 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:45:53.600743 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de0754-0abc-4c6a-8f35-caa43b83f98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:45:53.601437 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de0754-0abc-4c6a-8f35-caa43b83f98c None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:45:53.604295 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de0754-0abc-4c6a-8f35-caa43b83f98c None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:45:53.604578 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de0754-0abc-4c6a-8f35-caa43b83f98c None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:45:53.605286 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de0754-0abc-4c6a-8f35-caa43b83f98c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:45:53.605571 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de0754-0abc-4c6a-8f35-caa43b83f98c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:45:53.606937 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de0754-0abc-4c6a-8f35-caa43b83f98c None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:45:53.621776 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 455/916] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:45:53.628339 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4d084-7fa8-49a5-820b-11d904afd27a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:45:53.749787 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4d084-7fa8-49a5-820b-11d904afd27a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:45:53.751333 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:45:53.786294 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e889b54-ac37-44d6-ac24-7f3d9b0cc71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:45:53.786908 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e889b54-ac37-44d6-ac24-7f3d9b0cc71d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:45:53.787230 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e889b54-ac37-44d6-ac24-7f3d9b0cc71d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:45:53.787498 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e889b54-ac37-44d6-ac24-7f3d9b0cc71d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:45:53.795490 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e889b54-ac37-44d6-ac24-7f3d9b0cc71d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:45:53.796922 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e889b54-ac37-44d6-ac24-7f3d9b0cc71d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:45:53.808823 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-1e889b54-ac37-44d6-ac24-7f3d9b0cc71d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 30 00:45:53.808823 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:45:53.808823 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:45:53.808823 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:45:53.808823 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:45:53.808823 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:45:53.808823 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:45:53.808823 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:45:53.808823 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:45:53.808823 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:45:53.808823 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:45:53.808823 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:45:53.808823 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:45:53.808823 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:45:53.808823 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:45:53.808823 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:45:53.809902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:45:53.809902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:45:53.809902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:45:53.809902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:45:53.809902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:45:53.809902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:45:53.809902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:45:53.809902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:45:53.809902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:45:53.809902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:45:53.809902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:45:53.809902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:45:53.809902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:45:53.809902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:45:53.809902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:45:53.809902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:45:53.809902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:45:53.809902 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:45:53.810883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:45:53.810883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:45:53.810883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:45:53.810883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:45:53.810883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:45:53.810883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:45:53.810883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:45:53.810883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:45:53.810883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 30 00:45:53.810883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:45:53.810883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 462/917] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:45:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:45:53.815874 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de0754-0abc-4c6a-8f35-caa43b83f98c None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:45:53.923034 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de0754-0abc-4c6a-8f35-caa43b83f98c None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:45:53.967515 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae617d-c2bc-4d66-bf5a-c6cc62d0ba66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:45:53.968157 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae617d-c2bc-4d66-bf5a-c6cc62d0ba66 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:45:53.968432 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae617d-c2bc-4d66-bf5a-c6cc62d0ba66 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:45:53.968701 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae617d-c2bc-4d66-bf5a-c6cc62d0ba66 None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:45:53.969506 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae617d-c2bc-4d66-bf5a-c6cc62d0ba66 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:45:53.969838 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae617d-c2bc-4d66-bf5a-c6cc62d0ba66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:45:53.971604 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae617d-c2bc-4d66-bf5a-c6cc62d0ba66 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:45:53.994881 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 456/918] 10.222.0.40 () {56 vars in 1143 bytes} [Sun Oct 30 00:45:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:45:54.001569 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e889b54-ac37-44d6-ac24-7f3d9b0cc71d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:45:54.117584 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e889b54-ac37-44d6-ac24-7f3d9b0cc71d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:45:54.154910 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd08d8-53aa-4dcb-8f34-8f17a5c5e089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:45:54.155757 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd08d8-53aa-4dcb-8f34-8f17a5c5e089 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:45:54.155965 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd08d8-53aa-4dcb-8f34-8f17a5c5e089 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:45:54.156230 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd08d8-53aa-4dcb-8f34-8f17a5c5e089 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:45:54.167105 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd08d8-53aa-4dcb-8f34-8f17a5c5e089 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:45:54.168539 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd08d8-53aa-4dcb-8f34-8f17a5c5e089 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:45:54.183134 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-6bdd08d8-53aa-4dcb-8f34-8f17a5c5e089 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:45:54.183134 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:45:54.183134 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:45:54.183134 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:45:54.183134 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:45:54.183134 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:45:54.183134 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:45:54.183134 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:45:54.183134 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:45:54.183134 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:45:54.183134 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:45:54.183134 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:45:54.183134 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:45:54.183134 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:45:54.183134 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:45:54.183134 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:45:54.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:45:54.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:45:54.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:45:54.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:45:54.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:45:54.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:45:54.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:45:54.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:45:54.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:45:54.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:45:54.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:45:54.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:45:54.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:45:54.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:45:54.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:45:54.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:45:54.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:45:54.185587 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:45:54.185587 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:45:54.185587 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:45:54.185587 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 463/919] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:45:54.190577 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae617d-c2bc-4d66-bf5a-c6cc62d0ba66 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:45:54.210480 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:45:54.306645 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae617d-c2bc-4d66-bf5a-c6cc62d0ba66 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:45:54.342510 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84632e-eec6-4dd0-a85d-c9c6fcf830fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:45:54.343268 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84632e-eec6-4dd0-a85d-c9c6fcf830fe None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:45:54.343645 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84632e-eec6-4dd0-a85d-c9c6fcf830fe None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:45:54.344009 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84632e-eec6-4dd0-a85d-c9c6fcf830fe None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:45:54.344727 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84632e-eec6-4dd0-a85d-c9c6fcf830fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:45:54.345127 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84632e-eec6-4dd0-a85d-c9c6fcf830fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:45:54.346585 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84632e-eec6-4dd0-a85d-c9c6fcf830fe None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:45:54.359646 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 457/920] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:45:54.365276 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd08d8-53aa-4dcb-8f34-8f17a5c5e089 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:45:54.383085 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:45:54.474084 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd08d8-53aa-4dcb-8f34-8f17a5c5e089 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:45:54.510182 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea41d8c-53d2-49fb-9445-1a95a84007f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:45:54.510994 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea41d8c-53d2-49fb-9445-1a95a84007f4 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:45:54.511396 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea41d8c-53d2-49fb-9445-1a95a84007f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:45:54.511765 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea41d8c-53d2-49fb-9445-1a95a84007f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:45:54.519024 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea41d8c-53d2-49fb-9445-1a95a84007f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:45:54.520651 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea41d8c-53d2-49fb-9445-1a95a84007f4 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:45:54.535692 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-dea41d8c-53d2-49fb-9445-1a95a84007f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:45:54.535692 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:45:54.535692 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:45:54.535692 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:45:54.535692 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:45:54.535692 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:45:54.535692 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:45:54.535692 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:45:54.535692 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:45:54.535692 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:45:54.535692 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:45:54.535692 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:45:54.535692 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:45:54.535692 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:45:54.535692 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:45:54.536829 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:45:54.536829 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:45:54.536829 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:45:54.536829 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:45:54.536829 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:45:54.536829 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:45:54.536829 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:45:54.536829 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:45:54.536829 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:45:54.536829 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:45:54.536829 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:45:54.536829 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:45:54.536829 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:45:54.536829 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:45:54.536829 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:45:54.536829 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:45:54.536829 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:45:54.542538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:45:54.542538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:45:54.542538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:45:54.542538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:45:54.542538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:45:54.542538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:45:54.542538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:45:54.542538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:45:54.542538 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 464/921] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:45:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:45:54.543057 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84632e-eec6-4dd0-a85d-c9c6fcf830fe None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:45:54.627565 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:45:54.651278 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84632e-eec6-4dd0-a85d-c9c6fcf830fe None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:45:54.687003 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e387b69-fd1a-4498-ae6d-23b0e7d54df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:45:54.687646 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e387b69-fd1a-4498-ae6d-23b0e7d54df4 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:45:54.687917 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e387b69-fd1a-4498-ae6d-23b0e7d54df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:45:54.688182 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e387b69-fd1a-4498-ae6d-23b0e7d54df4 None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:45:54.688914 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e387b69-fd1a-4498-ae6d-23b0e7d54df4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:45:54.689243 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e387b69-fd1a-4498-ae6d-23b0e7d54df4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:45:54.690700 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e387b69-fd1a-4498-ae6d-23b0e7d54df4 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:45:54.708101 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 458/922] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Oct 30 00:45:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:45:54.709327 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea41d8c-53d2-49fb-9445-1a95a84007f4 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:45:54.797640 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:45:54.826484 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea41d8c-53d2-49fb-9445-1a95a84007f4 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:45:54.864485 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca597cc0-b4a1-498a-ade2-178fedfc39a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:45:54.865118 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca597cc0-b4a1-498a-ade2-178fedfc39a3 None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:45:54.865437 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca597cc0-b4a1-498a-ade2-178fedfc39a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:45:54.865745 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca597cc0-b4a1-498a-ade2-178fedfc39a3 None admin] PATH_INFO: `/v3/projects/8969ed754fe24784a2025cbdbf6f1a8b/users/d7f009bdf1d24ee4b879db926b8d44cf/roles/53b761158f744776b470f11e00bdaa81` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:45:54.881418 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca597cc0-b4a1-498a-ade2-178fedfc39a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=8969ed754fe24784a2025cbdbf6f1a8b, user_id=d7f009bdf1d24ee4b879db926b8d44cf, role_id=53b761158f744776b470f11e00bdaa81)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:45:54.886426 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca597cc0-b4a1-498a-ade2-178fedfc39a3 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:45:54.899201 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 465/923] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Oct 30 00:45:54 2022] PUT /identity/v3/projects/8969ed754fe24784a2025cbdbf6f1a8b/users/d7f009bdf1d24ee4b879db926b8d44cf/roles/53b761158f744776b470f11e00bdaa81 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:45:57.054197 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6aa9ea-7c02-4670-9ef7-b21c41bc5c57 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:45:57.054747 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6aa9ea-7c02-4670-9ef7-b21c41bc5c57 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:45:57.054747 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6aa9ea-7c02-4670-9ef7-b21c41bc5c57 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:45:57.056786 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 459/924] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:45:57.061800 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef155b-9054-46e6-b176-62a23d63d46c None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:45:57.062201 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef155b-9054-46e6-b176-62a23d63d46c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:45:57.062363 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef155b-9054-46e6-b176-62a23d63d46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:45:57.081125 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-2cef155b-9054-46e6-b176-62a23d63d46c None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:45:57.082430 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2cef155b-9054-46e6-b176-62a23d63d46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:45:57.152610 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 466/925] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:45:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:45:57.433980 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6aa9ea-7c02-4670-9ef7-b21c41bc5c57 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:45:57.537964 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6aa9ea-7c02-4670-9ef7-b21c41bc5c57 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:45:57.572191 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283b4fa-3116-4d91-bc8c-b8850a146c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:45:57.572808 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283b4fa-3116-4d91-bc8c-b8850a146c89 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:45:57.573080 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283b4fa-3116-4d91-bc8c-b8850a146c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:45:57.573371 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283b4fa-3116-4d91-bc8c-b8850a146c89 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:45:57.581005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:45:57.585575 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7283b4fa-3116-4d91-bc8c-b8850a146c89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:45:57.590885 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-7283b4fa-3116-4d91-bc8c-b8850a146c89 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:45:57.590885 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:45:57.590885 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:45:57.590885 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:45:57.590885 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:45:57.590885 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:45:57.590885 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:45:57.590885 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:45:57.590885 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:45:57.590885 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:45:57.590885 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:45:57.590885 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:45:57.590885 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:45:57.590885 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:45:57.590885 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:45:57.590885 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:45:57.592184 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:45:57.592184 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:45:57.592184 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:45:57.592184 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:45:57.592184 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:45:57.592184 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:45:57.592184 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:45:57.592184 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:45:57.592184 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:45:57.592184 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:45:57.592184 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:45:57.592184 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:45:57.592184 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:45:57.592184 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:45:57.592184 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:45:57.592184 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:45:57.593231 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:45:57.593231 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:45:57.593231 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:45:57.593231 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:45:57.593231 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:45:57.593231 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:45:57.593231 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:45:57.593231 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:45:57.593231 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:45:57.593231 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:45:57.593231 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:45:57.593231 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:45:57.593231 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 460/926] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Oct 30 00:45:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:45:57.598478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef155b-9054-46e6-b176-62a23d63d46c None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:45:57.656583 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:45:57.705583 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef155b-9054-46e6-b176-62a23d63d46c None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:45:57.743661 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec0d43-067a-4ccd-87db-f8bcc1c36ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:45:57.744838 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec0d43-067a-4ccd-87db-f8bcc1c36ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:45:57.745114 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec0d43-067a-4ccd-87db-f8bcc1c36ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:45:57.745427 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec0d43-067a-4ccd-87db-f8bcc1c36ba0 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:45:57.746087 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec0d43-067a-4ccd-87db-f8bcc1c36ba0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:45:57.746387 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec0d43-067a-4ccd-87db-f8bcc1c36ba0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:45:57.747753 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec0d43-067a-4ccd-87db-f8bcc1c36ba0 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:45:57.756176 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 467/927] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Oct 30 00:45:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:45:57.762798 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283b4fa-3116-4d91-bc8c-b8850a146c89 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:45:57.882233 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283b4fa-3116-4d91-bc8c-b8850a146c89 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:45:57.920120 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4bdbc-2e94-4f77-ad97-237204cf70a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:45:57.920733 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4bdbc-2e94-4f77-ad97-237204cf70a4 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:45:57.921005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4bdbc-2e94-4f77-ad97-237204cf70a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:45:57.921303 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4bdbc-2e94-4f77-ad97-237204cf70a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:45:57.931725 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc4bdbc-2e94-4f77-ad97-237204cf70a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:45:57.933519 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc4bdbc-2e94-4f77-ad97-237204cf70a4 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:45:57.950509 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-5fc4bdbc-2e94-4f77-ad97-237204cf70a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:45:57.950509 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:45:57.950509 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:45:57.950509 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:45:57.950509 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:45:57.950509 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:45:57.950509 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:45:57.950509 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:45:57.950509 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:45:57.950509 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:45:57.950509 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:45:57.950509 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:45:57.950509 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:45:57.950509 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:45:57.950509 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:45:57.950509 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:45:57.951664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:45:57.951664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:45:57.951664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:45:57.951664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:45:57.951664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:45:57.951664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:45:57.951664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:45:57.951664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:45:57.951664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:45:57.951664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:45:57.951664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:45:57.951664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:45:57.951664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:45:57.951664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:45:57.951664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:45:57.951664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:45:57.951664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:45:57.952754 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:45:57.952754 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:45:57.952754 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:45:57.952754 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 461/928] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:45:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:45:57.957760 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec0d43-067a-4ccd-87db-f8bcc1c36ba0 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:45:58.066726 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec0d43-067a-4ccd-87db-f8bcc1c36ba0 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:45:58.084681 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:45:58.104255 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4033de1-bea2-4c39-81d7-312c47036059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:45:58.104857 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4033de1-bea2-4c39-81d7-312c47036059 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:45:58.105134 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4033de1-bea2-4c39-81d7-312c47036059 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:45:58.105433 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4033de1-bea2-4c39-81d7-312c47036059 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:45:58.106066 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4033de1-bea2-4c39-81d7-312c47036059 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:45:58.106362 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4033de1-bea2-4c39-81d7-312c47036059 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:45:58.107734 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4033de1-bea2-4c39-81d7-312c47036059 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:45:58.125336 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 468/929] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:45:58.126615 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4bdbc-2e94-4f77-ad97-237204cf70a4 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:45:58.184825 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:45:58.239193 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4bdbc-2e94-4f77-ad97-237204cf70a4 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:45:58.276293 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f27ba-4766-4c85-8ef8-cb792805fed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:45:58.277210 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f27ba-4766-4c85-8ef8-cb792805fed6 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:45:58.277495 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f27ba-4766-4c85-8ef8-cb792805fed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:45:58.277760 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f27ba-4766-4c85-8ef8-cb792805fed6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:45:58.285286 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f27ba-4766-4c85-8ef8-cb792805fed6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:45:58.286694 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f27ba-4766-4c85-8ef8-cb792805fed6 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:45:58.298090 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-db4f27ba-4766-4c85-8ef8-cb792805fed6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 30 00:45:58.298090 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:45:58.298090 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:45:58.298090 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:45:58.298090 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:45:58.298090 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:45:58.298090 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:45:58.298090 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:45:58.298090 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:45:58.298090 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:45:58.298090 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:45:58.298090 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:45:58.298090 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:45:58.298090 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:45:58.298090 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:45:58.298090 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:45:58.299227 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:45:58.299227 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:45:58.299227 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:45:58.299227 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:45:58.299227 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:45:58.299227 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:45:58.299227 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:45:58.299227 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:45:58.299227 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:45:58.299227 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:45:58.299227 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:45:58.299227 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:45:58.299227 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:45:58.299227 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:45:58.299227 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:45:58.299227 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:45:58.299227 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:45:58.299227 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:45:58.300170 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:45:58.300170 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:45:58.300170 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:45:58.300170 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:45:58.300170 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:45:58.300170 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:45:58.300170 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:45:58.300170 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:45:58.300170 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 30 00:45:58.300170 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:45:58.300170 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 462/930] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:45:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:45:58.305130 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4033de1-bea2-4c39-81d7-312c47036059 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:45:58.412100 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4033de1-bea2-4c39-81d7-312c47036059 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:45:58.448077 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d0b3d-06d4-42b6-a990-d7818a342012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:45:58.448762 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d0b3d-06d4-42b6-a990-d7818a342012 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:45:58.449109 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d0b3d-06d4-42b6-a990-d7818a342012 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:45:58.449428 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d0b3d-06d4-42b6-a990-d7818a342012 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:45:58.450199 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d0b3d-06d4-42b6-a990-d7818a342012 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:45:58.450469 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d0b3d-06d4-42b6-a990-d7818a342012 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:45:58.451885 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d0b3d-06d4-42b6-a990-d7818a342012 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:45:58.469283 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 469/931] 10.222.0.40 () {56 vars in 1143 bytes} [Sun Oct 30 00:45:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:45:58.475134 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f27ba-4766-4c85-8ef8-cb792805fed6 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:45:58.597184 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f27ba-4766-4c85-8ef8-cb792805fed6 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:45:58.608107 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:45:58.634419 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bedc4-7753-4a63-9518-0f318c55b0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:45:58.635333 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bedc4-7753-4a63-9518-0f318c55b0a2 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:45:58.635587 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bedc4-7753-4a63-9518-0f318c55b0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:45:58.635923 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bedc4-7753-4a63-9518-0f318c55b0a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:45:58.721052 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2bedc4-7753-4a63-9518-0f318c55b0a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:45:58.722551 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2bedc4-7753-4a63-9518-0f318c55b0a2 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:45:58.845365 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 463/932] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Oct 30 00:45:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 30 00:45:58.852238 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d0b3d-06d4-42b6-a990-d7818a342012 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:45:58.893567 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:45:58.968204 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d0b3d-06d4-42b6-a990-d7818a342012 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:45:59.005071 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a540e49-d244-445e-9ad4-7024045d9208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:45:59.005721 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a540e49-d244-445e-9ad4-7024045d9208 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:45:59.005997 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a540e49-d244-445e-9ad4-7024045d9208 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:45:59.006263 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a540e49-d244-445e-9ad4-7024045d9208 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:45:59.017829 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a540e49-d244-445e-9ad4-7024045d9208 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:45:59.019254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a540e49-d244-445e-9ad4-7024045d9208 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:45:59.034190 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-2a540e49-d244-445e-9ad4-7024045d9208 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:45:59.034190 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:45:59.034190 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:45:59.034190 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:45:59.034190 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:45:59.034190 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:45:59.034190 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:45:59.034190 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:45:59.034190 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:45:59.034190 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:45:59.034190 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:45:59.034190 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:45:59.034190 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:45:59.034190 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:45:59.034190 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:45:59.034190 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:45:59.035360 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:45:59.035360 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:45:59.035360 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:45:59.035360 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:45:59.035360 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:45:59.035360 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:45:59.035360 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:45:59.035360 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:45:59.035360 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:45:59.035360 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:45:59.035360 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:45:59.035360 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:45:59.035360 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:45:59.035360 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:45:59.035360 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:45:59.035360 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:45:59.035360 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:45:59.036415 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:45:59.036415 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:45:59.036415 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:45:59.036415 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 470/933] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:45:59.041507 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bedc4-7753-4a63-9518-0f318c55b0a2 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:45:59.053976 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:45:59.144483 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bedc4-7753-4a63-9518-0f318c55b0a2 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:45:59.183409 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20ffb5-41f2-451d-bc18-ad7b64673e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:45:59.184081 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20ffb5-41f2-451d-bc18-ad7b64673e3a None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:45:59.184396 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20ffb5-41f2-451d-bc18-ad7b64673e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:45:59.184689 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20ffb5-41f2-451d-bc18-ad7b64673e3a None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:45:59.185404 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20ffb5-41f2-451d-bc18-ad7b64673e3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:45:59.185700 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20ffb5-41f2-451d-bc18-ad7b64673e3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:45:59.187185 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20ffb5-41f2-451d-bc18-ad7b64673e3a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:45:59.199860 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 464/934] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:45:59.205556 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a540e49-d244-445e-9ad4-7024045d9208 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:45:59.305309 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:45:59.327190 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a540e49-d244-445e-9ad4-7024045d9208 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:45:59.370691 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d20e0-803e-4fc0-ad4b-d235e0b1a82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:45:59.371308 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d20e0-803e-4fc0-ad4b-d235e0b1a82c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:45:59.371581 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d20e0-803e-4fc0-ad4b-d235e0b1a82c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:45:59.371845 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d20e0-803e-4fc0-ad4b-d235e0b1a82c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:45:59.378675 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d20e0-803e-4fc0-ad4b-d235e0b1a82c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:45:59.380099 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d20e0-803e-4fc0-ad4b-d235e0b1a82c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:45:59.390965 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-af4d20e0-803e-4fc0-ad4b-d235e0b1a82c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:45:59.390965 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:45:59.390965 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:45:59.390965 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:45:59.390965 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:45:59.390965 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:45:59.390965 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:45:59.390965 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:45:59.390965 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:45:59.390965 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:45:59.390965 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:45:59.390965 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:45:59.390965 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:45:59.390965 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:45:59.390965 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:45:59.391928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:45:59.391928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:45:59.391928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:45:59.391928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:45:59.391928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:45:59.391928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:45:59.391928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:45:59.391928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:45:59.391928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:45:59.391928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:45:59.391928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:45:59.391928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:45:59.391928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:45:59.391928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:45:59.391928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:45:59.391928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:45:59.391928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:45:59.392845 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:45:59.392845 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:45:59.392845 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:45:59.392845 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:45:59.392845 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:45:59.392845 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:45:59.392845 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:45:59.392845 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:45:59.392845 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 471/935] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:45:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:45:59.398725 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20ffb5-41f2-451d-bc18-ad7b64673e3a None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:45:59.478523 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:45:59.509355 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20ffb5-41f2-451d-bc18-ad7b64673e3a None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:45:59.544722 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0d7e9-eed9-4fc5-b36e-9fbef15d0091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:45:59.545383 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0d7e9-eed9-4fc5-b36e-9fbef15d0091 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:45:59.545678 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0d7e9-eed9-4fc5-b36e-9fbef15d0091 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:45:59.545942 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0d7e9-eed9-4fc5-b36e-9fbef15d0091 None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:45:59.546689 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0d7e9-eed9-4fc5-b36e-9fbef15d0091 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:45:59.547067 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0d7e9-eed9-4fc5-b36e-9fbef15d0091 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:45:59.548542 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0d7e9-eed9-4fc5-b36e-9fbef15d0091 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:45:59.561125 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 465/936] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Oct 30 00:45:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:45:59.567162 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d20e0-803e-4fc0-ad4b-d235e0b1a82c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:45:59.681403 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d20e0-803e-4fc0-ad4b-d235e0b1a82c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:45:59.720235 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a32bf-558d-4e34-ba43-2642552de0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:45:59.720827 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a32bf-558d-4e34-ba43-2642552de0a0 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:45:59.721075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a32bf-558d-4e34-ba43-2642552de0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:45:59.721376 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a32bf-558d-4e34-ba43-2642552de0a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:45:59.722087 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a32bf-558d-4e34-ba43-2642552de0a0 None admin] RBAC: Adding query filter params (role.id=53b761158f744776b470f11e00bdaa81, scope.project.id=8969ed754fe24784a2025cbdbf6f1a8b, user.id=d7f009bdf1d24ee4b879db926b8d44cf) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:45:59.722384 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a32bf-558d-4e34-ba43-2642552de0a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:45:59.723796 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a32bf-558d-4e34-ba43-2642552de0a0 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:45:59.733376 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 472/937] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Oct 30 00:45:59 2022] GET /identity/v3/role_assignments?user.id=d7f009bdf1d24ee4b879db926b8d44cf&scope.project.id=8969ed754fe24784a2025cbdbf6f1a8b&role.id=53b761158f744776b470f11e00bdaa81 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:46:01.933263 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390d78b-c92e-4265-b529-7435ed9336b2 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:01.933784 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390d78b-c92e-4265-b529-7435ed9336b2 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:01.933784 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390d78b-c92e-4265-b529-7435ed9336b2 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:01.935105 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 466/938] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:46:01.940456 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a432e-0096-4632-85c8-648c89f5cae5 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:01.940896 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a432e-0096-4632-85c8-648c89f5cae5 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:01.940994 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a432e-0096-4632-85c8-648c89f5cae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:01.959311 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-6e1a432e-0096-4632-85c8-648c89f5cae5 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:46:01.960493 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6e1a432e-0096-4632-85c8-648c89f5cae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:46:01.963855 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:02.030812 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 473/939] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:46:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:46:02.303129 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390d78b-c92e-4265-b529-7435ed9336b2 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:02.412258 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390d78b-c92e-4265-b529-7435ed9336b2 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:02.442180 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:02.449092 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31517ca-b73b-4034-9277-db1be0778da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:02.449729 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31517ca-b73b-4034-9277-db1be0778da1 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:02.450002 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31517ca-b73b-4034-9277-db1be0778da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:02.450267 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31517ca-b73b-4034-9277-db1be0778da1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:02.460150 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31517ca-b73b-4034-9277-db1be0778da1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:46:02.465728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-d31517ca-b73b-4034-9277-db1be0778da1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:46:02.465728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:46:02.465728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:46:02.465728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:46:02.465728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:46:02.465728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:46:02.465728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:46:02.465728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:46:02.465728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:46:02.465728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:46:02.465728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:46:02.465728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:46:02.465728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:46:02.465728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:46:02.465728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:46:02.465728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:46:02.466895 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:46:02.466895 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:46:02.466895 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:46:02.466895 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:46:02.466895 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:46:02.466895 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:46:02.466895 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:46:02.466895 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:46:02.466895 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:46:02.466895 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:46:02.466895 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:46:02.466895 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:46:02.466895 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:46:02.466895 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:46:02.466895 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:46:02.466895 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:46:02.467963 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:46:02.467963 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:46:02.467963 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:46:02.467963 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:46:02.467963 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:46:02.467963 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:46:02.467963 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:46:02.467963 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:46:02.467963 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:46:02.467963 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:46:02.467963 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:46:02.467963 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:46:02.467963 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 467/940] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Oct 30 00:46:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:46:02.472992 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a432e-0096-4632-85c8-648c89f5cae5 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:02.584689 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a432e-0096-4632-85c8-648c89f5cae5 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:02.623687 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b68dd-e7de-488d-ab19-343c730cab5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:02.624286 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b68dd-e7de-488d-ab19-343c730cab5e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:02.624558 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b68dd-e7de-488d-ab19-343c730cab5e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:02.624855 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b68dd-e7de-488d-ab19-343c730cab5e None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:02.625531 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b68dd-e7de-488d-ab19-343c730cab5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:46:02.625825 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b68dd-e7de-488d-ab19-343c730cab5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:02.627175 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b68dd-e7de-488d-ab19-343c730cab5e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:02.635786 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 474/941] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:46:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:46:02.641622 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31517ca-b73b-4034-9277-db1be0778da1 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:02.763734 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31517ca-b73b-4034-9277-db1be0778da1 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:02.801462 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01217ac7-77ed-431e-aabc-fdb9e06837e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:02.802191 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01217ac7-77ed-431e-aabc-fdb9e06837e7 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:02.802463 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01217ac7-77ed-431e-aabc-fdb9e06837e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:02.802730 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01217ac7-77ed-431e-aabc-fdb9e06837e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:02.813584 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01217ac7-77ed-431e-aabc-fdb9e06837e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:02.815016 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01217ac7-77ed-431e-aabc-fdb9e06837e7 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:02.829642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-01217ac7-77ed-431e-aabc-fdb9e06837e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:46:02.829642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:46:02.829642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:46:02.829642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:46:02.829642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:46:02.829642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:46:02.829642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:46:02.829642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:46:02.829642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:46:02.829642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:46:02.829642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:46:02.829642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:46:02.829642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:46:02.829642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:46:02.829642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:46:02.829642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:46:02.830795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:46:02.830795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:46:02.830795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:46:02.830795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:46:02.830795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:46:02.830795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:46:02.830795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:46:02.830795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:46:02.830795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:46:02.830795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:46:02.830795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:46:02.830795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:46:02.830795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:46:02.830795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:46:02.830795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:46:02.830795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:46:02.830795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:46:02.831718 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:46:02.831718 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:46:02.831718 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:46:02.831718 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 468/942] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:46:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:46:02.836898 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b68dd-e7de-488d-ab19-343c730cab5e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:02.839830 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:02.937020 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b68dd-e7de-488d-ab19-343c730cab5e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:02.976016 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a7f1f-b9ca-445e-9696-ae6d1f5905aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:02.976690 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a7f1f-b9ca-445e-9696-ae6d1f5905aa None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:02.976885 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a7f1f-b9ca-445e-9696-ae6d1f5905aa None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:02.977153 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a7f1f-b9ca-445e-9696-ae6d1f5905aa None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:02.978325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a7f1f-b9ca-445e-9696-ae6d1f5905aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:46:02.978624 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a7f1f-b9ca-445e-9696-ae6d1f5905aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:02.979973 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a7f1f-b9ca-445e-9696-ae6d1f5905aa None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:02.992011 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 475/943] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:46:02.998470 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01217ac7-77ed-431e-aabc-fdb9e06837e7 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:03.041950 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:03.098797 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01217ac7-77ed-431e-aabc-fdb9e06837e7 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:03.134173 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd67e2-a7c8-4558-a759-265568549820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:03.134781 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd67e2-a7c8-4558-a759-265568549820 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:03.135056 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd67e2-a7c8-4558-a759-265568549820 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:03.135326 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd67e2-a7c8-4558-a759-265568549820 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:03.144382 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd67e2-a7c8-4558-a759-265568549820 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:03.145847 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd67e2-a7c8-4558-a759-265568549820 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:03.157728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-c1bd67e2-a7c8-4558-a759-265568549820 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 30 00:46:03.157728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:46:03.157728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:46:03.157728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:46:03.157728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:46:03.157728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:46:03.157728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:46:03.157728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:46:03.157728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:46:03.157728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:46:03.157728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:46:03.157728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:46:03.157728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:46:03.157728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:46:03.157728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:46:03.157728 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:46:03.158962 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:46:03.158962 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:46:03.158962 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:46:03.158962 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:46:03.158962 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:46:03.158962 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:46:03.158962 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:46:03.158962 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:46:03.158962 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:46:03.158962 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:46:03.158962 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:46:03.158962 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:46:03.158962 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:46:03.158962 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:46:03.158962 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:46:03.158962 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:46:03.158962 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:46:03.158962 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:46:03.160027 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:46:03.160027 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:46:03.160027 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:46:03.160027 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:46:03.160027 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:46:03.160027 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:46:03.160027 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:46:03.160027 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:46:03.160027 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 30 00:46:03.160027 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:46:03.160027 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 469/944] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:46:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:46:03.164896 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a7f1f-b9ca-445e-9696-ae6d1f5905aa None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:03.231112 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:03.274293 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a7f1f-b9ca-445e-9696-ae6d1f5905aa None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:03.313530 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e70e5a-4b10-4992-a040-776808da0730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:03.314340 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e70e5a-4b10-4992-a040-776808da0730 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:03.314622 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e70e5a-4b10-4992-a040-776808da0730 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:03.314947 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e70e5a-4b10-4992-a040-776808da0730 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:03.315822 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e70e5a-4b10-4992-a040-776808da0730 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:46:03.316147 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e70e5a-4b10-4992-a040-776808da0730 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:03.318119 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e70e5a-4b10-4992-a040-776808da0730 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:03.340628 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 476/945] 10.222.0.40 () {56 vars in 1143 bytes} [Sun Oct 30 00:46:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:46:03.346529 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd67e2-a7c8-4558-a759-265568549820 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:03.452393 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd67e2-a7c8-4558-a759-265568549820 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:03.453941 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:03.490089 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a050e-424f-457d-9dfd-499f4dbda454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:03.490718 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a050e-424f-457d-9dfd-499f4dbda454 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:03.490974 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a050e-424f-457d-9dfd-499f4dbda454 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:03.491244 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a050e-424f-457d-9dfd-499f4dbda454 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:03.502603 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a050e-424f-457d-9dfd-499f4dbda454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:03.504211 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a050e-424f-457d-9dfd-499f4dbda454 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:03.519463 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-b92a050e-424f-457d-9dfd-499f4dbda454 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:46:03.519463 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:46:03.519463 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:46:03.519463 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:46:03.519463 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:46:03.519463 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:46:03.519463 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:46:03.519463 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:46:03.519463 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:46:03.519463 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:46:03.519463 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:46:03.519463 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:46:03.519463 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:46:03.519463 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:46:03.519463 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:46:03.519463 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:46:03.520594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:46:03.520594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:46:03.520594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:46:03.520594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:46:03.520594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:46:03.520594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:46:03.520594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:46:03.520594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:46:03.520594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:46:03.520594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:46:03.520594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:46:03.520594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:46:03.520594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:46:03.520594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:46:03.520594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:46:03.520594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:46:03.520594 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:46:03.521549 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:46:03.521549 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:46:03.521549 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:46:03.521549 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 470/946] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:46:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:46:03.528036 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e70e5a-4b10-4992-a040-776808da0730 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:03.635111 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e70e5a-4b10-4992-a040-776808da0730 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:03.655337 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:03.673496 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750803a-c3d0-41dd-b6f3-f043112ef004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:03.674166 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750803a-c3d0-41dd-b6f3-f043112ef004 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:03.674511 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750803a-c3d0-41dd-b6f3-f043112ef004 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:03.674853 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750803a-c3d0-41dd-b6f3-f043112ef004 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:03.675567 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750803a-c3d0-41dd-b6f3-f043112ef004 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:46:03.675897 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750803a-c3d0-41dd-b6f3-f043112ef004 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:03.677441 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750803a-c3d0-41dd-b6f3-f043112ef004 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:03.691109 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 477/947] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:46:03.697634 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a050e-424f-457d-9dfd-499f4dbda454 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:03.804468 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a050e-424f-457d-9dfd-499f4dbda454 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:03.837802 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f765c-1d5b-456b-b505-f8a48058ec1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:03.838433 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f765c-1d5b-456b-b505-f8a48058ec1b None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:03.838703 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f765c-1d5b-456b-b505-f8a48058ec1b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:03.838965 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f765c-1d5b-456b-b505-f8a48058ec1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:03.846895 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f765c-1d5b-456b-b505-f8a48058ec1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:03.848369 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f765c-1d5b-456b-b505-f8a48058ec1b None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:03.860050 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-508f765c-1d5b-456b-b505-f8a48058ec1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:46:03.860050 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:46:03.860050 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:46:03.860050 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:46:03.860050 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:46:03.860050 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:46:03.860050 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:46:03.860050 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:46:03.860050 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:46:03.860050 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:46:03.860050 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:46:03.860050 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:46:03.860050 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:46:03.860050 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:46:03.860050 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:46:03.862042 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:46:03.862042 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:46:03.862042 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:46:03.862042 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:46:03.862042 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:46:03.862042 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:46:03.862042 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:46:03.862042 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:46:03.862042 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:46:03.862042 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:46:03.862042 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:46:03.862042 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:46:03.862042 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:46:03.862042 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:46:03.862042 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:46:03.862042 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:46:03.862042 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:46:03.863062 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:46:03.863062 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:46:03.863062 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:46:03.863062 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:46:03.863062 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:46:03.863062 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:46:03.863062 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:46:03.863062 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:46:03.863062 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 471/948] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:46:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:46:03.867404 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750803a-c3d0-41dd-b6f3-f043112ef004 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:03.973314 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750803a-c3d0-41dd-b6f3-f043112ef004 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:04.011121 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e7296-fffb-4524-b8f3-f82e60a11ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:04.011774 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e7296-fffb-4524-b8f3-f82e60a11ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:04.012207 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e7296-fffb-4524-b8f3-f82e60a11ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:04.012611 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e7296-fffb-4524-b8f3-f82e60a11ef0 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:04.013425 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e7296-fffb-4524-b8f3-f82e60a11ef0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:46:04.013777 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e7296-fffb-4524-b8f3-f82e60a11ef0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:04.015520 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e7296-fffb-4524-b8f3-f82e60a11ef0 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:04.028640 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 478/949] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Oct 30 00:46:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:46:04.035806 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f765c-1d5b-456b-b505-f8a48058ec1b None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:04.053964 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:04.152727 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f765c-1d5b-456b-b505-f8a48058ec1b None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:04.189144 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5d75a-3a38-448e-9af6-2f0fca34deff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:04.189920 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5d75a-3a38-448e-9af6-2f0fca34deff None admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:04.190234 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5d75a-3a38-448e-9af6-2f0fca34deff None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:04.190567 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5d75a-3a38-448e-9af6-2f0fca34deff None admin] PATH_INFO: `/v3/projects/8969ed754fe24784a2025cbdbf6f1a8b/users/d7f009bdf1d24ee4b879db926b8d44cf/roles/17d0330d6df84d3091d7ef234dfc4e6b` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:04.192781 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d5d75a-3a38-448e-9af6-2f0fca34deff None admin] RBAC: Authorizing `identity:create_grant(project_id=8969ed754fe24784a2025cbdbf6f1a8b, user_id=d7f009bdf1d24ee4b879db926b8d44cf, role_id=17d0330d6df84d3091d7ef234dfc4e6b)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:04.194401 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d5d75a-3a38-448e-9af6-2f0fca34deff None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:04.208656 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 472/950] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Oct 30 00:46:04 2022] PUT /identity/v3/projects/8969ed754fe24784a2025cbdbf6f1a8b/users/d7f009bdf1d24ee4b879db926b8d44cf/roles/17d0330d6df84d3091d7ef234dfc4e6b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:46:06.504946 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce67a16-25cc-4947-860b-1d8e579df5f6 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:06.505589 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce67a16-25cc-4947-860b-1d8e579df5f6 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:06.505701 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce67a16-25cc-4947-860b-1d8e579df5f6 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:06.507054 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 479/951] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:46:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:46:06.513136 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b13ab3-0f04-4b23-a2b4-9abdac239ce8 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:06.513612 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b13ab3-0f04-4b23-a2b4-9abdac239ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:06.513723 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b13ab3-0f04-4b23-a2b4-9abdac239ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:06.531951 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-a9b13ab3-0f04-4b23-a2b4-9abdac239ce8 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:46:06.533133 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a9b13ab3-0f04-4b23-a2b4-9abdac239ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:46:06.602665 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 473/952] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:46:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:46:06.869921 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce67a16-25cc-4947-860b-1d8e579df5f6 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:06.917888 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:06.984242 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce67a16-25cc-4947-860b-1d8e579df5f6 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:07.022079 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f710a0-3414-4da4-9b69-e2e3ef1b26cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:07.022828 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f710a0-3414-4da4-9b69-e2e3ef1b26cf None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:07.023059 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f710a0-3414-4da4-9b69-e2e3ef1b26cf None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:07.023326 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f710a0-3414-4da4-9b69-e2e3ef1b26cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:07.034611 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f710a0-3414-4da4-9b69-e2e3ef1b26cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:46:07.039777 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-c5f710a0-3414-4da4-9b69-e2e3ef1b26cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:46:07.039777 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:46:07.039777 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:46:07.039777 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:46:07.039777 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:46:07.039777 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:46:07.039777 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:46:07.039777 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:46:07.039777 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:46:07.039777 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:46:07.039777 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:46:07.039777 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:46:07.039777 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:46:07.039777 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:46:07.039777 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:46:07.039777 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:46:07.041294 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:46:07.041294 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:46:07.041294 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:46:07.041294 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:46:07.041294 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:46:07.041294 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:46:07.041294 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:46:07.041294 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:46:07.041294 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:46:07.041294 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:46:07.041294 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:46:07.041294 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:46:07.041294 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:46:07.041294 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:46:07.041294 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:46:07.041294 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:46:07.042167 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:46:07.042167 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:46:07.042167 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:46:07.042167 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:46:07.042167 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:46:07.042167 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:46:07.042167 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:46:07.042167 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:46:07.042167 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:46:07.042167 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:46:07.042167 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:46:07.042167 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:46:07.042167 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 480/953] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Oct 30 00:46:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:46:07.048039 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b13ab3-0f04-4b23-a2b4-9abdac239ce8 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:07.051428 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:07.153480 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b13ab3-0f04-4b23-a2b4-9abdac239ce8 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:07.188295 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b92b1b-d03f-4aa9-a28f-7a31a13001cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:07.188897 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b92b1b-d03f-4aa9-a28f-7a31a13001cd None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:07.189172 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b92b1b-d03f-4aa9-a28f-7a31a13001cd None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:07.189548 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b92b1b-d03f-4aa9-a28f-7a31a13001cd None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:07.190194 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b92b1b-d03f-4aa9-a28f-7a31a13001cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:46:07.190490 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b92b1b-d03f-4aa9-a28f-7a31a13001cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:07.191857 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b92b1b-d03f-4aa9-a28f-7a31a13001cd None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:07.199978 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 474/954] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Oct 30 00:46:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:46:07.206221 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f710a0-3414-4da4-9b69-e2e3ef1b26cf None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:07.311683 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:07.315331 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f710a0-3414-4da4-9b69-e2e3ef1b26cf None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:07.358054 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a021ee-d65b-495b-bd15-3b14b1394258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:07.359238 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a021ee-d65b-495b-bd15-3b14b1394258 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:07.359620 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a021ee-d65b-495b-bd15-3b14b1394258 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:07.359939 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a021ee-d65b-495b-bd15-3b14b1394258 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:07.371312 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a021ee-d65b-495b-bd15-3b14b1394258 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:07.372742 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a021ee-d65b-495b-bd15-3b14b1394258 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:07.387865 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-e5a021ee-d65b-495b-bd15-3b14b1394258 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:46:07.387865 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:46:07.387865 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:46:07.387865 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:46:07.387865 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:46:07.387865 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:46:07.387865 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:46:07.387865 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:46:07.387865 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:46:07.387865 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:46:07.387865 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:46:07.387865 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:46:07.387865 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:46:07.387865 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:46:07.387865 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:46:07.387865 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:46:07.389075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:46:07.389075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:46:07.389075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:46:07.389075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:46:07.389075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:46:07.389075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:46:07.389075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:46:07.389075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:46:07.389075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:46:07.389075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:46:07.389075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:46:07.389075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:46:07.389075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:46:07.389075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:46:07.389075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:46:07.389075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:46:07.389075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:46:07.390156 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:46:07.390156 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:46:07.390156 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:46:07.390156 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 481/955] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:46:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:46:07.394755 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b92b1b-d03f-4aa9-a28f-7a31a13001cd None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:07.465230 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:07.503746 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b92b1b-d03f-4aa9-a28f-7a31a13001cd None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:07.539437 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbc350-dfc3-41b4-8695-f5cca758d55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:07.540223 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbc350-dfc3-41b4-8695-f5cca758d55d None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:07.540350 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbc350-dfc3-41b4-8695-f5cca758d55d None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:07.540556 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbc350-dfc3-41b4-8695-f5cca758d55d None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:07.541228 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbc350-dfc3-41b4-8695-f5cca758d55d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:46:07.541579 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbc350-dfc3-41b4-8695-f5cca758d55d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:07.542861 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbc350-dfc3-41b4-8695-f5cca758d55d None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:07.555575 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 475/956] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:46:07.561550 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a021ee-d65b-495b-bd15-3b14b1394258 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:07.670210 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a021ee-d65b-495b-bd15-3b14b1394258 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:07.707297 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551f234-d963-4e26-b313-ce0edbe68fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:07.708321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551f234-d963-4e26-b313-ce0edbe68fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:07.708601 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551f234-d963-4e26-b313-ce0edbe68fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:07.708872 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551f234-d963-4e26-b313-ce0edbe68fa5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:07.717022 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0551f234-d963-4e26-b313-ce0edbe68fa5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:07.718572 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0551f234-d963-4e26-b313-ce0edbe68fa5 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:07.730408 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-0551f234-d963-4e26-b313-ce0edbe68fa5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 30 00:46:07.730408 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:46:07.730408 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:46:07.730408 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:46:07.730408 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:46:07.730408 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:46:07.730408 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:46:07.730408 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:46:07.730408 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:46:07.730408 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:46:07.730408 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:46:07.730408 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:46:07.730408 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:46:07.730408 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:46:07.730408 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:46:07.730408 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:46:07.731610 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:46:07.731610 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:46:07.731610 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:46:07.731610 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:46:07.731610 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:46:07.731610 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:46:07.731610 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:46:07.731610 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:46:07.731610 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:46:07.731610 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:46:07.731610 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:46:07.731610 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:46:07.731610 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:46:07.731610 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:46:07.731610 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:46:07.731610 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:46:07.731610 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:46:07.731610 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:46:07.732867 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:46:07.732867 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:46:07.732867 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:46:07.732867 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:46:07.732867 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:46:07.732867 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:46:07.732867 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:46:07.732867 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:46:07.732867 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 30 00:46:07.732867 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:46:07.732867 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 482/957] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:46:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:46:07.737637 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbc350-dfc3-41b4-8695-f5cca758d55d None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:07.843927 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbc350-dfc3-41b4-8695-f5cca758d55d None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:07.871749 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:07.882422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45c7c5-6f67-4a86-8948-e36eec393744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:07.883026 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45c7c5-6f67-4a86-8948-e36eec393744 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:07.883300 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45c7c5-6f67-4a86-8948-e36eec393744 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:07.883566 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45c7c5-6f67-4a86-8948-e36eec393744 None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:07.884829 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45c7c5-6f67-4a86-8948-e36eec393744 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:46:07.885128 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45c7c5-6f67-4a86-8948-e36eec393744 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:07.886576 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45c7c5-6f67-4a86-8948-e36eec393744 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:07.905262 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 476/958] 10.222.0.40 () {56 vars in 1143 bytes} [Sun Oct 30 00:46:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:46:07.911683 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551f234-d963-4e26-b313-ce0edbe68fa5 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:07.927792 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:08.022725 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551f234-d963-4e26-b313-ce0edbe68fa5 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:08.059925 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9251d4-a189-41ff-8278-cb7c39738e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:08.060636 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9251d4-a189-41ff-8278-cb7c39738e27 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:08.060926 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9251d4-a189-41ff-8278-cb7c39738e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:08.061332 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9251d4-a189-41ff-8278-cb7c39738e27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:08.132795 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9251d4-a189-41ff-8278-cb7c39738e27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:08.134997 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9251d4-a189-41ff-8278-cb7c39738e27 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:08.152425 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:08.249083 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 483/959] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Oct 30 00:46:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 30 00:46:08.255075 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45c7c5-6f67-4a86-8948-e36eec393744 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:08.368563 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45c7c5-6f67-4a86-8948-e36eec393744 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:08.406019 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b18bfe-721a-4f1f-9ba1-ad297d9c3308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:08.406655 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b18bfe-721a-4f1f-9ba1-ad297d9c3308 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:08.406932 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b18bfe-721a-4f1f-9ba1-ad297d9c3308 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:08.407202 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b18bfe-721a-4f1f-9ba1-ad297d9c3308 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:08.418030 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b18bfe-721a-4f1f-9ba1-ad297d9c3308 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:08.419476 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b18bfe-721a-4f1f-9ba1-ad297d9c3308 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:08.434449 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-64b18bfe-721a-4f1f-9ba1-ad297d9c3308 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:46:08.434449 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:46:08.434449 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:46:08.434449 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:46:08.434449 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:46:08.434449 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:46:08.434449 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:46:08.434449 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:46:08.434449 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:46:08.434449 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:46:08.434449 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:46:08.434449 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:46:08.434449 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:46:08.434449 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:46:08.434449 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:46:08.434449 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:46:08.435652 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:46:08.435652 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:46:08.435652 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:46:08.435652 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:46:08.435652 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:46:08.435652 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:46:08.435652 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:46:08.435652 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:46:08.435652 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:46:08.435652 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:46:08.435652 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:46:08.435652 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:46:08.435652 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:46:08.435652 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:46:08.435652 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:46:08.435652 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:46:08.435652 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:46:08.436547 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:46:08.436547 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:46:08.436547 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:46:08.436547 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 477/960] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:46:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:46:08.441451 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9251d4-a189-41ff-8278-cb7c39738e27 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:08.546257 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9251d4-a189-41ff-8278-cb7c39738e27 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:08.559906 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:08.582729 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f17c5-ec91-4043-b26f-eb7f5d5f9f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:08.583387 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f17c5-ec91-4043-b26f-eb7f5d5f9f2f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:08.583597 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f17c5-ec91-4043-b26f-eb7f5d5f9f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:08.583861 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f17c5-ec91-4043-b26f-eb7f5d5f9f2f None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:08.584504 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f17c5-ec91-4043-b26f-eb7f5d5f9f2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:46:08.584801 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f17c5-ec91-4043-b26f-eb7f5d5f9f2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:08.586202 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f17c5-ec91-4043-b26f-eb7f5d5f9f2f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:08.598765 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 484/961] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Oct 30 00:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:46:08.604652 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b18bfe-721a-4f1f-9ba1-ad297d9c3308 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:08.641753 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:08.708349 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b18bfe-721a-4f1f-9ba1-ad297d9c3308 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:08.742501 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8100a8-15a8-4f04-829d-71277e243753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:08.743653 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8100a8-15a8-4f04-829d-71277e243753 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:08.743925 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8100a8-15a8-4f04-829d-71277e243753 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:08.744193 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8100a8-15a8-4f04-829d-71277e243753 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:08.751113 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8100a8-15a8-4f04-829d-71277e243753 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:08.752531 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8100a8-15a8-4f04-829d-71277e243753 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:08.763616 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-db8100a8-15a8-4f04-829d-71277e243753 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:46:08.763616 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:46:08.763616 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:46:08.763616 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:46:08.763616 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:46:08.763616 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:46:08.763616 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:46:08.763616 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:46:08.763616 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:46:08.763616 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:46:08.763616 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:46:08.763616 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:46:08.763616 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:46:08.763616 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:46:08.763616 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:46:08.764669 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:46:08.764669 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:46:08.764669 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:46:08.764669 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:46:08.764669 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:46:08.764669 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:46:08.764669 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:46:08.764669 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:46:08.764669 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Oct 30 00:46:08.764669 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:46:08.764669 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:46:08.764669 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:46:08.764669 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:46:08.764669 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:46:08.764669 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:46:08.764669 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:46:08.764669 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:46:08.765831 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:46:08.765831 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:46:08.765831 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:46:08.765831 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:46:08.765831 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:46:08.765831 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:46:08.765831 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:46:08.765831 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: ERROR keystone.server.flask.application Oct 30 00:46:08.765831 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 478/962] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Oct 30 00:46:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:46:08.772281 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f17c5-ec91-4043-b26f-eb7f5d5f9f2f None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:08.878702 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f17c5-ec91-4043-b26f-eb7f5d5f9f2f None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:08.911494 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb3c84-d2c1-49e1-9b01-d576fdfffd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:08.912019 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb3c84-d2c1-49e1-9b01-d576fdfffd40 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:08.912291 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb3c84-d2c1-49e1-9b01-d576fdfffd40 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:08.912553 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb3c84-d2c1-49e1-9b01-d576fdfffd40 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:08.913239 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb3c84-d2c1-49e1-9b01-d576fdfffd40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:46:08.913537 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb3c84-d2c1-49e1-9b01-d576fdfffd40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:08.914992 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb3c84-d2c1-49e1-9b01-d576fdfffd40 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:08.926349 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 485/963] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Oct 30 00:46:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:46:08.932994 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8100a8-15a8-4f04-829d-71277e243753 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:09.023707 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:09.029636 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8100a8-15a8-4f04-829d-71277e243753 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:09.061901 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0f74d-1a3f-4789-97d5-e9c6a35baaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:09.062467 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0f74d-1a3f-4789-97d5-e9c6a35baaf9 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:09.062737 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0f74d-1a3f-4789-97d5-e9c6a35baaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:09.063000 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0f74d-1a3f-4789-97d5-e9c6a35baaf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:09.063697 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0f74d-1a3f-4789-97d5-e9c6a35baaf9 None admin] RBAC: Adding query filter params (role.id=17d0330d6df84d3091d7ef234dfc4e6b, scope.project.id=8969ed754fe24784a2025cbdbf6f1a8b, user.id=d7f009bdf1d24ee4b879db926b8d44cf) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:46:09.063993 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0f74d-1a3f-4789-97d5-e9c6a35baaf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:09.065416 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0f74d-1a3f-4789-97d5-e9c6a35baaf9 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:09.070836 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 479/964] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Oct 30 00:46:08 2022] GET /identity/v3/role_assignments?user.id=d7f009bdf1d24ee4b879db926b8d44cf&scope.project.id=8969ed754fe24784a2025cbdbf6f1a8b&role.id=17d0330d6df84d3091d7ef234dfc4e6b => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:46:11.164561 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3deb9d-3b73-4491-b795-e49330bc8f66 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:11.165109 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3deb9d-3b73-4491-b795-e49330bc8f66 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:11.165109 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3deb9d-3b73-4491-b795-e49330bc8f66 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:11.166471 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 486/965] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:46:11.171540 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50645a-e7fe-4b5b-9bf1-8a5139c38c7f None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:11.171904 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50645a-e7fe-4b5b-9bf1-8a5139c38c7f None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:11.172078 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50645a-e7fe-4b5b-9bf1-8a5139c38c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:11.190477 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-fd50645a-e7fe-4b5b-9bf1-8a5139c38c7f None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:46:11.191637 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-fd50645a-e7fe-4b5b-9bf1-8a5139c38c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:46:11.256212 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 480/966] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:46:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:46:11.520586 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3deb9d-3b73-4491-b795-e49330bc8f66 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:11.550968 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:11.618278 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3deb9d-3b73-4491-b795-e49330bc8f66 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:11.650227 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67396a0-667c-4617-954d-457895b9bfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:11.651072 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67396a0-667c-4617-954d-457895b9bfba None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:11.651340 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67396a0-667c-4617-954d-457895b9bfba None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:11.651597 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67396a0-667c-4617-954d-457895b9bfba None admin] PATH_INFO: `/v3/services/placement` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:11.652150 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67396a0-667c-4617-954d-457895b9bfba None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:11.653510 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67396a0-667c-4617-954d-457895b9bfba None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:11.661864 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-d67396a0-667c-4617-954d-457895b9bfba None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 30 00:46:11.661864 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:46:11.661864 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:46:11.661864 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:46:11.661864 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:46:11.661864 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:46:11.661864 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:46:11.661864 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:46:11.661864 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 30 00:46:11.661864 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:46:11.661864 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:46:11.661864 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:46:11.661864 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:46:11.661864 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:46:11.661864 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:46:11.661864 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:46:11.661864 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:46:11.662883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:46:11.662883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:46:11.662883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:46:11.662883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:46:11.662883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:46:11.662883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:46:11.662883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:46:11.662883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:46:11.662883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:46:11.662883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:46:11.662883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:46:11.662883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:46:11.662883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:46:11.662883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:46:11.662883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:46:11.662883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:46:11.663745 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:46:11.663745 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:46:11.663745 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:46:11.663745 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:46:11.663745 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:46:11.663745 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:46:11.663745 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:46:11.663745 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:46:11.663745 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:46:11.663745 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:46:11.663745 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:46:11.663745 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:46:11.663745 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 30 00:46:11.663745 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:46:11.665628 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 487/967] 10.222.0.40 () {56 vars in 1117 bytes} [Sun Oct 30 00:46:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:46:11.669449 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50645a-e7fe-4b5b-9bf1-8a5139c38c7f None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:11.755276 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:11.764488 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50645a-e7fe-4b5b-9bf1-8a5139c38c7f None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:11.797668 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e9f5a-a955-4121-8e64-8dcd35d26fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:11.798196 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e9f5a-a955-4121-8e64-8dcd35d26fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:11.798465 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e9f5a-a955-4121-8e64-8dcd35d26fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:11.798729 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e9f5a-a955-4121-8e64-8dcd35d26fe0 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:11.799338 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e9f5a-a955-4121-8e64-8dcd35d26fe0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:46:11.799630 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e9f5a-a955-4121-8e64-8dcd35d26fe0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:11.800979 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e9f5a-a955-4121-8e64-8dcd35d26fe0 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:11.805610 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 481/968] 10.222.0.40 () {56 vars in 1116 bytes} [Sun Oct 30 00:46:11 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:46:11.811353 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67396a0-667c-4617-954d-457895b9bfba None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:11.901453 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:11.907744 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67396a0-667c-4617-954d-457895b9bfba None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:11.940239 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c023b-aa40-49d4-9493-7c6a625c3d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:11.940839 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c023b-aa40-49d4-9493-7c6a625c3d7d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:11.941116 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c023b-aa40-49d4-9493-7c6a625c3d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:11.941413 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c023b-aa40-49d4-9493-7c6a625c3d7d None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:11.942026 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c023b-aa40-49d4-9493-7c6a625c3d7d None admin] RBAC: Adding query filter params (type=placement) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:46:11.942320 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c023b-aa40-49d4-9493-7c6a625c3d7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:11.943659 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c023b-aa40-49d4-9493-7c6a625c3d7d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:11.947914 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 488/969] 10.222.0.40 () {56 vars in 1116 bytes} [Sun Oct 30 00:46:11 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:46:14.051101 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7b852-5ef4-4bc7-bd23-9479007c4465 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:14.051617 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7b852-5ef4-4bc7-bd23-9479007c4465 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:14.051617 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7b852-5ef4-4bc7-bd23-9479007c4465 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:14.052943 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 482/970] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:46:14.058161 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb4e4e-e9c8-45c8-a64c-089587e7bed3 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:14.058555 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb4e4e-e9c8-45c8-a64c-089587e7bed3 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:14.058703 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb4e4e-e9c8-45c8-a64c-089587e7bed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:14.076342 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-eacb4e4e-e9c8-45c8-a64c-089587e7bed3 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:46:14.077547 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-eacb4e4e-e9c8-45c8-a64c-089587e7bed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:46:14.140714 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 489/971] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:46:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:46:14.405721 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7b852-5ef4-4bc7-bd23-9479007c4465 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:14.501144 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7b852-5ef4-4bc7-bd23-9479007c4465 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:14.533763 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3374a6d-b6cd-486e-99d2-06b04106309d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:14.534334 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3374a6d-b6cd-486e-99d2-06b04106309d None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:14.534605 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3374a6d-b6cd-486e-99d2-06b04106309d None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:14.534870 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3374a6d-b6cd-486e-99d2-06b04106309d None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:14.535508 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3374a6d-b6cd-486e-99d2-06b04106309d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:14.536840 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3374a6d-b6cd-486e-99d2-06b04106309d None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:14.550524 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 483/972] 10.222.0.40 () {60 vars in 1141 bytes} [Sun Oct 30 00:46:14 2022] POST /identity/v3/services => generated 246 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:46:16.698182 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53acb55-48b3-40c0-8e93-e2956578b3a8 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:16.698638 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53acb55-48b3-40c0-8e93-e2956578b3a8 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:16.698734 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53acb55-48b3-40c0-8e93-e2956578b3a8 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:16.700035 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 490/973] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:46:16.705057 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ac8ef-aa6e-4042-8acc-caf9136c17a0 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:16.705531 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ac8ef-aa6e-4042-8acc-caf9136c17a0 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:16.705636 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ac8ef-aa6e-4042-8acc-caf9136c17a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:16.723821 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-e85ac8ef-aa6e-4042-8acc-caf9136c17a0 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:46:16.724993 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-e85ac8ef-aa6e-4042-8acc-caf9136c17a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:46:16.734038 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:16.796156 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 484/974] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:46:16 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:46:17.061464 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53acb55-48b3-40c0-8e93-e2956578b3a8 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:17.148543 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:17.159287 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53acb55-48b3-40c0-8e93-e2956578b3a8 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:17.191797 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d3670-0f5c-420d-a197-3aaa8e1e853a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:17.192403 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d3670-0f5c-420d-a197-3aaa8e1e853a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:17.192677 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d3670-0f5c-420d-a197-3aaa8e1e853a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:17.192945 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d3670-0f5c-420d-a197-3aaa8e1e853a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:17.193542 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d3670-0f5c-420d-a197-3aaa8e1e853a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:17.194885 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d3670-0f5c-420d-a197-3aaa8e1e853a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:17.204027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-361d3670-0f5c-420d-a197-3aaa8e1e853a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 30 00:46:17.204027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:46:17.204027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:46:17.204027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:46:17.204027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:46:17.204027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:46:17.204027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:46:17.204027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:46:17.204027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 30 00:46:17.204027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:46:17.204027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:46:17.204027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:46:17.204027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:46:17.204027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:46:17.204027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:46:17.204027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:46:17.204027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:46:17.205379 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:46:17.205379 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:46:17.205379 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:46:17.205379 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:46:17.205379 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:46:17.205379 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:46:17.205379 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:46:17.205379 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:46:17.205379 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:46:17.205379 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:46:17.205379 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:46:17.205379 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:46:17.205379 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:46:17.205379 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:46:17.205379 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:46:17.205379 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:46:17.206309 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:46:17.206309 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:46:17.206309 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:46:17.206309 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:46:17.206309 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:46:17.206309 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:46:17.206309 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:46:17.206309 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:46:17.206309 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:46:17.206309 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:46:17.206309 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:46:17.206309 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:46:17.206309 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 30 00:46:17.206309 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:46:17.206309 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 491/975] 10.222.0.40 () {56 vars in 1117 bytes} [Sun Oct 30 00:46:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:46:17.211089 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ac8ef-aa6e-4042-8acc-caf9136c17a0 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:17.306519 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ac8ef-aa6e-4042-8acc-caf9136c17a0 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:17.341397 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6661f-520c-4e3c-99d2-726e552dff0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:17.341922 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6661f-520c-4e3c-99d2-726e552dff0e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:17.342191 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6661f-520c-4e3c-99d2-726e552dff0e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:17.342457 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6661f-520c-4e3c-99d2-726e552dff0e None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:17.343079 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6661f-520c-4e3c-99d2-726e552dff0e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:46:17.343369 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6661f-520c-4e3c-99d2-726e552dff0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:17.344748 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6661f-520c-4e3c-99d2-726e552dff0e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:17.350024 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 485/976] 10.222.0.40 () {56 vars in 1116 bytes} [Sun Oct 30 00:46:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:46:17.356851 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d3670-0f5c-420d-a197-3aaa8e1e853a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:17.454831 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d3670-0f5c-420d-a197-3aaa8e1e853a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:17.486829 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac802ff-edd9-4bdc-8185-9d9c15704225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:17.487407 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac802ff-edd9-4bdc-8185-9d9c15704225 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:17.487680 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac802ff-edd9-4bdc-8185-9d9c15704225 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:17.487947 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac802ff-edd9-4bdc-8185-9d9c15704225 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:17.488629 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac802ff-edd9-4bdc-8185-9d9c15704225 None admin] RBAC: Adding query filter params (interface=public, service_id=35ce7d0b2c4d42d1a03c254498a10b7b, region_id=RegionOne) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:46:17.488929 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac802ff-edd9-4bdc-8185-9d9c15704225 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:17.490327 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac802ff-edd9-4bdc-8185-9d9c15704225 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:17.495672 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 492/977] 10.222.0.40 () {56 vars in 1251 bytes} [Sun Oct 30 00:46:17 2022] GET /identity/v3/endpoints?service_id=35ce7d0b2c4d42d1a03c254498a10b7b&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:46:17.501269 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6661f-520c-4e3c-99d2-726e552dff0e None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:17.504936 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:17.598040 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6661f-520c-4e3c-99d2-726e552dff0e None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:17.631552 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c0d58-6932-4288-bf27-58eb579cb509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:17.632131 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c0d58-6932-4288-bf27-58eb579cb509 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:17.632406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c0d58-6932-4288-bf27-58eb579cb509 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:17.632678 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c0d58-6932-4288-bf27-58eb579cb509 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:17.633293 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c0d58-6932-4288-bf27-58eb579cb509 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:17.634667 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c0d58-6932-4288-bf27-58eb579cb509 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:17.641303 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 486/978] 10.222.0.40 () {56 vars in 1087 bytes} [Sun Oct 30 00:46:17 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:46:19.761602 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f98b5-80f6-4db1-a3ff-ca51123d8c29 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:19.762110 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f98b5-80f6-4db1-a3ff-ca51123d8c29 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:19.762215 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f98b5-80f6-4db1-a3ff-ca51123d8c29 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:19.763455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 493/979] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:46:19.768544 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909368d7-1ebd-4cc6-a2f6-634a4b4c8ace None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:19.768931 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909368d7-1ebd-4cc6-a2f6-634a4b4c8ace None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:19.769099 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909368d7-1ebd-4cc6-a2f6-634a4b4c8ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:19.787560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-909368d7-1ebd-4cc6-a2f6-634a4b4c8ace None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:46:19.788733 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-909368d7-1ebd-4cc6-a2f6-634a4b4c8ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:46:19.848055 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:19.853387 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 487/980] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:46:19 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:46:20.118835 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f98b5-80f6-4db1-a3ff-ca51123d8c29 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:20.138284 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:20.218027 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f98b5-80f6-4db1-a3ff-ca51123d8c29 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:20.250598 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ccf2e-095b-467a-a99a-58d8f520a077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:20.251202 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ccf2e-095b-467a-a99a-58d8f520a077 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:20.251477 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ccf2e-095b-467a-a99a-58d8f520a077 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:20.251743 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ccf2e-095b-467a-a99a-58d8f520a077 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:20.252301 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ccf2e-095b-467a-a99a-58d8f520a077 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:20.253691 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ccf2e-095b-467a-a99a-58d8f520a077 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:20.262260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-f36ccf2e-095b-467a-a99a-58d8f520a077 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 30 00:46:20.262260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:46:20.262260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:46:20.262260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:46:20.262260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:46:20.262260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:46:20.262260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:46:20.262260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:46:20.262260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 30 00:46:20.262260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:46:20.262260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:46:20.262260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:46:20.262260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:46:20.262260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:46:20.262260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:46:20.262260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:46:20.262260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:46:20.263397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:46:20.263397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:46:20.263397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:46:20.263397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:46:20.263397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:46:20.263397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:46:20.263397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:46:20.263397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:46:20.263397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:46:20.263397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:46:20.263397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:46:20.263397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:46:20.263397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:46:20.263397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:46:20.263397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:46:20.263397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:46:20.264397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:46:20.264397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Oct 30 00:46:20.264397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:46:20.264397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:46:20.264397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:46:20.264397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:46:20.264397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:46:20.264397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:46:20.264397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:46:20.264397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:46:20.264397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:46:20.264397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:46:20.264397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 30 00:46:20.264397 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: ERROR keystone.server.flask.application Oct 30 00:46:20.268299 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 494/981] 10.222.0.40 () {56 vars in 1117 bytes} [Sun Oct 30 00:46:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:46:20.269367 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909368d7-1ebd-4cc6-a2f6-634a4b4c8ace None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:20.375028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909368d7-1ebd-4cc6-a2f6-634a4b4c8ace None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:20.406979 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93453b-de98-4820-9249-3315dd9ae7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:20.407561 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93453b-de98-4820-9249-3315dd9ae7fa None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:20.407832 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93453b-de98-4820-9249-3315dd9ae7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:20.408095 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93453b-de98-4820-9249-3315dd9ae7fa None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:20.408700 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93453b-de98-4820-9249-3315dd9ae7fa None admin] RBAC: Adding query filter params (name=placement) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:46:20.408991 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93453b-de98-4820-9249-3315dd9ae7fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:20.410369 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93453b-de98-4820-9249-3315dd9ae7fa None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:20.415733 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 488/982] 10.222.0.40 () {56 vars in 1116 bytes} [Sun Oct 30 00:46:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:46:20.421848 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ccf2e-095b-467a-a99a-58d8f520a077 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:20.500499 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:20.518119 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ccf2e-095b-467a-a99a-58d8f520a077 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:20.550615 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d413d40-adc1-4e24-8154-f0d3bf8456d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:20.551193 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d413d40-adc1-4e24-8154-f0d3bf8456d3 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:20.551470 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d413d40-adc1-4e24-8154-f0d3bf8456d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:20.551736 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d413d40-adc1-4e24-8154-f0d3bf8456d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:20.552379 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d413d40-adc1-4e24-8154-f0d3bf8456d3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:20.553756 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d413d40-adc1-4e24-8154-f0d3bf8456d3 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:20.572579 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 495/983] 10.222.0.40 () {60 vars in 1144 bytes} [Sun Oct 30 00:46:20 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:46:30.412311 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=69 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:30.568287 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:47:23.633211 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76f7d7-addd-4e3b-ad78-7ac9ae847ab6 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:23.633785 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76f7d7-addd-4e3b-ad78-7ac9ae847ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:23.633785 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76f7d7-addd-4e3b-ad78-7ac9ae847ab6 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:23.635401 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 489/984] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:47:23.640297 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57009c64-e72c-442c-8a51-a217ed489a98 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:23.640733 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57009c64-e72c-442c-8a51-a217ed489a98 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:23.640814 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57009c64-e72c-442c-8a51-a217ed489a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:23.744019 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-57009c64-e72c-442c-8a51-a217ed489a98 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:47:23.747845 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-57009c64-e72c-442c-8a51-a217ed489a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:23.916518 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 496/985] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:47:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:47:24.222022 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db801fe-33bc-45b0-8234-7e8321ab15b9 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:24.222319 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db801fe-33bc-45b0-8234-7e8321ab15b9 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:24.222561 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db801fe-33bc-45b0-8234-7e8321ab15b9 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:24.224034 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 490/986] 10.222.0.40 () {54 vars in 965 bytes} [Sun Oct 30 00:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:47:24.230862 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd0da5-01a8-40a3-b337-60c3cd02ec5b None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:24.231215 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd0da5-01a8-40a3-b337-60c3cd02ec5b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:24.231558 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd0da5-01a8-40a3-b337-60c3cd02ec5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:24.312591 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-22bd0da5-01a8-40a3-b337-60c3cd02ec5b None None] MFA Rules not processed for user `93b5c95d6fd64262849f4c09fe0a716f`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:47:24.313822 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-22bd0da5-01a8-40a3-b337-60c3cd02ec5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:24.334849 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:47:24.392712 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 497/987] 10.222.0.40 () {58 vars in 1062 bytes} [Sun Oct 30 00:47:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:47:24.403743 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db801fe-33bc-45b0-8234-7e8321ab15b9 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:47:24.406119 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-3db801fe-33bc-45b0-8234-7e8321ab15b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:24.534449 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db801fe-33bc-45b0-8234-7e8321ab15b9 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:47:24.620406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c450b71-34d3-48de-98f5-e1d7189bf464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:47:24.621008 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c450b71-34d3-48de-98f5-e1d7189bf464 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:24.621315 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c450b71-34d3-48de-98f5-e1d7189bf464 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:24.621588 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c450b71-34d3-48de-98f5-e1d7189bf464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:24.623189 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9c450b71-34d3-48de-98f5-e1d7189bf464 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:24.686405 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:47:24.746845 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c450b71-34d3-48de-98f5-e1d7189bf464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:47:24.748401 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c450b71-34d3-48de-98f5-e1d7189bf464 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:47:24.767921 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 491/988] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:47:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:47:27.220936 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c94204-1af6-4e18-90ce-08b6ab733d66 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:27.221522 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c94204-1af6-4e18-90ce-08b6ab733d66 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:27.221522 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c94204-1af6-4e18-90ce-08b6ab733d66 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:27.222990 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 498/989] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:47:27.228428 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefeb2f6-8e3c-4296-86be-6cd55b5ee9fd None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:27.228888 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefeb2f6-8e3c-4296-86be-6cd55b5ee9fd None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:27.228982 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefeb2f6-8e3c-4296-86be-6cd55b5ee9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:27.316918 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-cefeb2f6-8e3c-4296-86be-6cd55b5ee9fd None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:47:27.318560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-cefeb2f6-8e3c-4296-86be-6cd55b5ee9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:27.414790 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 492/990] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:47:27.694837 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c94204-1af6-4e18-90ce-08b6ab733d66 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:47:27.696871 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-80c94204-1af6-4e18-90ce-08b6ab733d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:27.802390 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c94204-1af6-4e18-90ce-08b6ab733d66 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:47:27.877138 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:47:27.879589 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00634074-b0b2-4af6-9fd1-e46b3340657f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:47:27.880167 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00634074-b0b2-4af6-9fd1-e46b3340657f service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:27.880637 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00634074-b0b2-4af6-9fd1-e46b3340657f service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:27.881065 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00634074-b0b2-4af6-9fd1-e46b3340657f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:27.882873 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-00634074-b0b2-4af6-9fd1-e46b3340657f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:27.991827 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00634074-b0b2-4af6-9fd1-e46b3340657f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:47:27.993705 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00634074-b0b2-4af6-9fd1-e46b3340657f service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:47:28.013868 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 499/991] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:47:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:47:30.450863 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130685c0-e782-46df-b525-60204bf91b88 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:30.451392 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130685c0-e782-46df-b525-60204bf91b88 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:30.451392 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130685c0-e782-46df-b525-60204bf91b88 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:30.452724 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 493/992] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:47:30.457901 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1e98e-1bed-4254-a584-e24f999992da None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:30.458338 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1e98e-1bed-4254-a584-e24f999992da None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:30.458432 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1e98e-1bed-4254-a584-e24f999992da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:30.525457 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-1ff1e98e-1bed-4254-a584-e24f999992da None None] MFA Rules not processed for user `bcee6ba45b114c7895de9db68a7a8696`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:47:30.526918 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-1ff1e98e-1bed-4254-a584-e24f999992da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:30.576976 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:47:30.620559 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 500/993] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:47:30 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:47:30.906453 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130685c0-e782-46df-b525-60204bf91b88 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:47:30.907986 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-130685c0-e782-46df-b525-60204bf91b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:30.918427 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:47:31.010431 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130685c0-e782-46df-b525-60204bf91b88 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:47:31.081680 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0509c4-e0b3-48ed-bef0-44ddb0671e56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:47:31.082267 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0509c4-e0b3-48ed-bef0-44ddb0671e56 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:31.082536 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0509c4-e0b3-48ed-bef0-44ddb0671e56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:31.082799 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0509c4-e0b3-48ed-bef0-44ddb0671e56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:31.084399 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-cc0509c4-e0b3-48ed-bef0-44ddb0671e56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:31.144864 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:47:31.190394 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0509c4-e0b3-48ed-bef0-44ddb0671e56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:47:31.191731 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0509c4-e0b3-48ed-bef0-44ddb0671e56 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:47:31.209355 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 494/994] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:47:30 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:47:33.855430 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50a92a-f23d-4462-949b-fb70198c2e71 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:33.855952 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50a92a-f23d-4462-949b-fb70198c2e71 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:33.855952 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50a92a-f23d-4462-949b-fb70198c2e71 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:33.857307 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 501/995] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:47:33.862465 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97172fe8-0b83-4dbc-9aee-48ca8e065148 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:33.862884 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97172fe8-0b83-4dbc-9aee-48ca8e065148 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:33.863045 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97172fe8-0b83-4dbc-9aee-48ca8e065148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:33.926713 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-97172fe8-0b83-4dbc-9aee-48ca8e065148 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:47:33.927833 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-97172fe8-0b83-4dbc-9aee-48ca8e065148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:34.022134 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 495/996] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:47:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:47:34.302541 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50a92a-f23d-4462-949b-fb70198c2e71 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:47:34.304049 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-be50a92a-f23d-4462-949b-fb70198c2e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:34.403024 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50a92a-f23d-4462-949b-fb70198c2e71 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:47:34.473032 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26db135-afa0-4d1a-a6c8-e39907e52142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:47:34.473645 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26db135-afa0-4d1a-a6c8-e39907e52142 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:34.473920 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26db135-afa0-4d1a-a6c8-e39907e52142 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:34.474185 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26db135-afa0-4d1a-a6c8-e39907e52142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:34.475749 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f26db135-afa0-4d1a-a6c8-e39907e52142 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:34.483154 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:47:34.582721 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26db135-afa0-4d1a-a6c8-e39907e52142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:47:34.584149 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26db135-afa0-4d1a-a6c8-e39907e52142 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:47:34.601983 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 502/997] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:47:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:47:37.392958 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0affe1-b5b6-41e8-8248-c997ef4853e8 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:37.393513 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0affe1-b5b6-41e8-8248-c997ef4853e8 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:37.393620 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0affe1-b5b6-41e8-8248-c997ef4853e8 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:37.395166 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 496/998] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:47:37.401667 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba798a4-ef07-46a2-9d20-febd43d711ea None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:37.402218 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba798a4-ef07-46a2-9d20-febd43d711ea None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:37.402218 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba798a4-ef07-46a2-9d20-febd43d711ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:37.475408 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-bba798a4-ef07-46a2-9d20-febd43d711ea None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:47:37.476648 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-bba798a4-ef07-46a2-9d20-febd43d711ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:37.540507 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:47:37.580845 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 503/999] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:47:37.863521 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0affe1-b5b6-41e8-8248-c997ef4853e8 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:47:37.865143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-0e0affe1-b5b6-41e8-8248-c997ef4853e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:37.885905 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:47:37.968843 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0affe1-b5b6-41e8-8248-c997ef4853e8 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:47:38.042786 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951cc9f-53dd-4711-8e9e-3ddd968b7b6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:47:38.043395 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951cc9f-53dd-4711-8e9e-3ddd968b7b6e service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:38.043668 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951cc9f-53dd-4711-8e9e-3ddd968b7b6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:38.043938 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951cc9f-53dd-4711-8e9e-3ddd968b7b6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:38.045601 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-3951cc9f-53dd-4711-8e9e-3ddd968b7b6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:38.117767 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:47:38.155941 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951cc9f-53dd-4711-8e9e-3ddd968b7b6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:47:38.157389 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951cc9f-53dd-4711-8e9e-3ddd968b7b6e service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:47:38.175284 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 497/1000] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:47:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:47:40.382196 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22c14e-03e0-4217-9235-188da387e2de None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:40.382719 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22c14e-03e0-4217-9235-188da387e2de None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:40.382719 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22c14e-03e0-4217-9235-188da387e2de None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:40.384587 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 504/1001] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:47:40.389891 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ee8f5-9422-4f87-acdf-825a355a9f31 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:40.390324 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ee8f5-9422-4f87-acdf-825a355a9f31 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:40.390415 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ee8f5-9422-4f87-acdf-825a355a9f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:40.463005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-400ee8f5-9422-4f87-acdf-825a355a9f31 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:47:40.464230 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-400ee8f5-9422-4f87-acdf-825a355a9f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:40.559559 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 498/1002] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:47:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:47:40.834782 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22c14e-03e0-4217-9235-188da387e2de None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:47:40.836366 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-dc22c14e-03e0-4217-9235-188da387e2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:40.937437 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22c14e-03e0-4217-9235-188da387e2de None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:47:41.010481 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449b982-d45a-4c59-8d8e-3122dcadea86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:47:41.011073 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449b982-d45a-4c59-8d8e-3122dcadea86 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:41.011353 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449b982-d45a-4c59-8d8e-3122dcadea86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:41.011625 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449b982-d45a-4c59-8d8e-3122dcadea86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:41.013272 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7449b982-d45a-4c59-8d8e-3122dcadea86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:41.030520 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:47:41.120262 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449b982-d45a-4c59-8d8e-3122dcadea86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:47:41.121637 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449b982-d45a-4c59-8d8e-3122dcadea86 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:47:41.139505 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 505/1003] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:47:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:47:43.332080 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c37375-c0ee-4e05-b8cc-66af7cd5f4ca None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:43.332507 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c37375-c0ee-4e05-b8cc-66af7cd5f4ca None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:43.332678 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c37375-c0ee-4e05-b8cc-66af7cd5f4ca None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:43.334128 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 499/1004] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:47:43.340233 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6d61b-3629-4b48-8824-acefcbaccd0a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:43.340688 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6d61b-3629-4b48-8824-acefcbaccd0a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:43.340778 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6d61b-3629-4b48-8824-acefcbaccd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:43.411296 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-dbc6d61b-3629-4b48-8824-acefcbaccd0a None None] MFA Rules not processed for user `bcee6ba45b114c7895de9db68a7a8696`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:47:43.412870 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-dbc6d61b-3629-4b48-8824-acefcbaccd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:43.484084 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:47:43.517652 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 506/1005] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:47:43 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:47:43.801303 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c37375-c0ee-4e05-b8cc-66af7cd5f4ca None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:47:43.802829 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-99c37375-c0ee-4e05-b8cc-66af7cd5f4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:43.836665 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:47:43.912223 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c37375-c0ee-4e05-b8cc-66af7cd5f4ca None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:47:43.985789 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9c7ef-17df-4958-b708-afd84b956fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:47:43.986399 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9c7ef-17df-4958-b708-afd84b956fde service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:43.986674 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9c7ef-17df-4958-b708-afd84b956fde service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:43.986938 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9c7ef-17df-4958-b708-afd84b956fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:43.988537 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-f0b9c7ef-17df-4958-b708-afd84b956fde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:44.066351 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:47:44.098396 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9c7ef-17df-4958-b708-afd84b956fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:47:44.099819 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9c7ef-17df-4958-b708-afd84b956fde service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:47:44.119226 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 500/1006] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:47:43 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:47:46.483723 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86d66c-8045-4642-820c-e01f7b21f4ef None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:46.484254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86d66c-8045-4642-820c-e01f7b21f4ef None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:46.484254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86d66c-8045-4642-820c-e01f7b21f4ef None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:46.485614 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 507/1007] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:47:46.490733 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23952e06-f7ff-4ac2-b10d-9c2aa2fe4d8c None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:46.491169 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23952e06-f7ff-4ac2-b10d-9c2aa2fe4d8c None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:46.491306 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23952e06-f7ff-4ac2-b10d-9c2aa2fe4d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:46.556192 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-23952e06-f7ff-4ac2-b10d-9c2aa2fe4d8c None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:47:46.557409 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-23952e06-f7ff-4ac2-b10d-9c2aa2fe4d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:46.650023 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 501/1008] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:47:46.946184 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de68ae7-b593-4823-b812-302e837c8261 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:46.946463 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de68ae7-b593-4823-b812-302e837c8261 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:46.946736 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de68ae7-b593-4823-b812-302e837c8261 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:46.948112 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 508/1009] 10.222.0.40 () {54 vars in 965 bytes} [Sun Oct 30 00:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:47:46.953778 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533c6e8-d03a-4db5-854d-c587f58a0751 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:46.954125 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533c6e8-d03a-4db5-854d-c587f58a0751 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:46.954406 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533c6e8-d03a-4db5-854d-c587f58a0751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:46.999640 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:47:47.031480 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-c533c6e8-d03a-4db5-854d-c587f58a0751 None None] MFA Rules not processed for user `93b5c95d6fd64262849f4c09fe0a716f`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:47:47.032678 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c533c6e8-d03a-4db5-854d-c587f58a0751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:47.105545 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 502/1010] 10.222.0.40 () {58 vars in 1062 bytes} [Sun Oct 30 00:47:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:47:47.114479 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de68ae7-b593-4823-b812-302e837c8261 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:47:47.116572 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8de68ae7-b593-4823-b812-302e837c8261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:47.216797 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de68ae7-b593-4823-b812-302e837c8261 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:47:47.288262 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59311ef6-7915-4deb-9da0-ee76f31900cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:47:47.288855 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59311ef6-7915-4deb-9da0-ee76f31900cb service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:47.289130 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59311ef6-7915-4deb-9da0-ee76f31900cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:47.289426 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59311ef6-7915-4deb-9da0-ee76f31900cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:47.290997 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-59311ef6-7915-4deb-9da0-ee76f31900cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:47.317062 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:47:47.396979 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59311ef6-7915-4deb-9da0-ee76f31900cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:47:47.398459 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59311ef6-7915-4deb-9da0-ee76f31900cb service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:47:47.416383 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 509/1011] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:47:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:47:49.830091 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca17fad-fd11-4e01-ad40-2a98b1261d03 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:49.830666 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca17fad-fd11-4e01-ad40-2a98b1261d03 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:49.830666 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca17fad-fd11-4e01-ad40-2a98b1261d03 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:49.831968 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 503/1012] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:47:49.837689 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00dfaf-5928-4ace-9bfd-3bbe1bde39d6 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:49.838132 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00dfaf-5928-4ace-9bfd-3bbe1bde39d6 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:49.838231 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00dfaf-5928-4ace-9bfd-3bbe1bde39d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:49.905179 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-ee00dfaf-5928-4ace-9bfd-3bbe1bde39d6 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:47:49.906417 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ee00dfaf-5928-4ace-9bfd-3bbe1bde39d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:49.979307 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:47:50.001057 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 510/1013] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:47:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:47:50.289118 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca17fad-fd11-4e01-ad40-2a98b1261d03 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:47:50.291230 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-5ca17fad-fd11-4e01-ad40-2a98b1261d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:50.393891 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca17fad-fd11-4e01-ad40-2a98b1261d03 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:47:50.422264 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:47:50.467901 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cf135-c77b-481f-80e3-59b550a85b73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:47:50.468500 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cf135-c77b-481f-80e3-59b550a85b73 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:50.468770 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cf135-c77b-481f-80e3-59b550a85b73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:50.469032 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cf135-c77b-481f-80e3-59b550a85b73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:50.470876 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-428cf135-c77b-481f-80e3-59b550a85b73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:50.578926 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cf135-c77b-481f-80e3-59b550a85b73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:47:50.580339 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cf135-c77b-481f-80e3-59b550a85b73 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:47:50.598414 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 504/1014] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:47:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:47:53.026459 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf450c-c6d3-4110-9c4e-6b646b2bf64e None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:53.027252 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf450c-c6d3-4110-9c4e-6b646b2bf64e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:53.027252 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf450c-c6d3-4110-9c4e-6b646b2bf64e None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:53.028587 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 511/1015] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:47:53.033924 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cd241-9ae6-4544-95d4-19c6cb5568ae None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:53.034347 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cd241-9ae6-4544-95d4-19c6cb5568ae None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:53.034492 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cd241-9ae6-4544-95d4-19c6cb5568ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:53.101104 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-b56cd241-9ae6-4544-95d4-19c6cb5568ae None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:47:53.102387 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-b56cd241-9ae6-4544-95d4-19c6cb5568ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:53.110589 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:47:53.202007 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 505/1016] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:47:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:47:53.493448 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf450c-c6d3-4110-9c4e-6b646b2bf64e None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:47:53.495790 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-acbf450c-c6d3-4110-9c4e-6b646b2bf64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:53.604274 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf450c-c6d3-4110-9c4e-6b646b2bf64e None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:47:53.681466 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06371b-b71d-4ea7-b4f6-c1e9ec93fa6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:47:53.682066 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06371b-b71d-4ea7-b4f6-c1e9ec93fa6c service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:53.682344 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06371b-b71d-4ea7-b4f6-c1e9ec93fa6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:53.682617 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06371b-b71d-4ea7-b4f6-c1e9ec93fa6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:53.684208 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fa06371b-b71d-4ea7-b4f6-c1e9ec93fa6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:53.720744 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:47:53.796255 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa06371b-b71d-4ea7-b4f6-c1e9ec93fa6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:47:53.797824 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa06371b-b71d-4ea7-b4f6-c1e9ec93fa6c service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:47:53.815720 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 512/1017] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:47:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:47:57.839530 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cc77d-9f67-4ca5-8ef9-e028feb096e0 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:57.840014 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cc77d-9f67-4ca5-8ef9-e028feb096e0 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:57.840211 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cc77d-9f67-4ca5-8ef9-e028feb096e0 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:57.841570 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 506/1018] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:47:57.846803 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f01d9-19b2-4f8e-a4df-f853cc2df3e9 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:57.847205 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f01d9-19b2-4f8e-a4df-f853cc2df3e9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:57.847472 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f01d9-19b2-4f8e-a4df-f853cc2df3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:57.914073 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-436f01d9-19b2-4f8e-a4df-f853cc2df3e9 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:47:57.915163 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-436f01d9-19b2-4f8e-a4df-f853cc2df3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:57.999065 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:47:58.012080 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 513/1019] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:47:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:47:58.297553 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52cc77d-9f67-4ca5-8ef9-e028feb096e0 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:47:58.299230 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-b52cc77d-9f67-4ca5-8ef9-e028feb096e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:58.405331 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52cc77d-9f67-4ca5-8ef9-e028feb096e0 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:47:58.444867 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:47:58.483011 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0af041-4798-491f-bc49-84cbbc27896d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:47:58.483595 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0af041-4798-491f-bc49-84cbbc27896d service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:47:58.483865 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0af041-4798-491f-bc49-84cbbc27896d service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:47:58.484129 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0af041-4798-491f-bc49-84cbbc27896d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:47:58.485724 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-0f0af041-4798-491f-bc49-84cbbc27896d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:47:58.595534 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0af041-4798-491f-bc49-84cbbc27896d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:47:58.597005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0af041-4798-491f-bc49-84cbbc27896d service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:47:58.614840 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 507/1020] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:47:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:01.402820 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eac687-fa52-45d7-944f-581ca2455ed2 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:01.403388 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eac687-fa52-45d7-944f-581ca2455ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:01.403388 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eac687-fa52-45d7-944f-581ca2455ed2 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:01.404681 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 514/1021] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:48:01.410004 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510b260-f693-42c4-ad30-76e5fa612474 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:01.410444 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510b260-f693-42c4-ad30-76e5fa612474 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:01.410549 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510b260-f693-42c4-ad30-76e5fa612474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:01.477446 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-a510b260-f693-42c4-ad30-76e5fa612474 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:01.478644 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a510b260-f693-42c4-ad30-76e5fa612474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:01.496655 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:01.577221 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 508/1022] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:48:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:01.855641 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eac687-fa52-45d7-944f-581ca2455ed2 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:01.857154 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-44eac687-fa52-45d7-944f-581ca2455ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:01.965545 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eac687-fa52-45d7-944f-581ca2455ed2 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:02.040464 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577cc273-0316-4929-8350-89e073235bb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:02.041079 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cc273-0316-4929-8350-89e073235bb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:02.041380 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cc273-0316-4929-8350-89e073235bb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:02.041648 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cc273-0316-4929-8350-89e073235bb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:02.043217 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-577cc273-0316-4929-8350-89e073235bb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:02.086146 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:02.153754 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577cc273-0316-4929-8350-89e073235bb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:02.155178 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577cc273-0316-4929-8350-89e073235bb2 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:02.174471 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 515/1023] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:06.267112 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae17f95-9a3b-4761-b83c-c109b738b0fb None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:06.267619 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae17f95-9a3b-4761-b83c-c109b738b0fb None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:06.267727 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae17f95-9a3b-4761-b83c-c109b738b0fb None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:06.268991 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 509/1024] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:48:06.274910 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbf4c9-cf94-4595-9a27-1bea29014da1 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:06.275293 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbf4c9-cf94-4595-9a27-1bea29014da1 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:06.275449 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbf4c9-cf94-4595-9a27-1bea29014da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:06.345849 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-64dbf4c9-cf94-4595-9a27-1bea29014da1 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:06.347054 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-64dbf4c9-cf94-4595-9a27-1bea29014da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:06.440985 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:06.443611 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 516/1025] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:06.721742 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae17f95-9a3b-4761-b83c-c109b738b0fb None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:06.723295 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-3ae17f95-9a3b-4761-b83c-c109b738b0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:06.824529 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae17f95-9a3b-4761-b83c-c109b738b0fb None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:06.872857 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:06.898353 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536ac90-7251-48fc-baa2-8247a7fd0be7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:06.899447 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536ac90-7251-48fc-baa2-8247a7fd0be7 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:06.899720 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536ac90-7251-48fc-baa2-8247a7fd0be7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:06.899987 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536ac90-7251-48fc-baa2-8247a7fd0be7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:06.901591 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-1536ac90-7251-48fc-baa2-8247a7fd0be7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:07.006924 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536ac90-7251-48fc-baa2-8247a7fd0be7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:07.008410 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536ac90-7251-48fc-baa2-8247a7fd0be7 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:07.027318 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 510/1026] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:11.943906 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d5efe-19be-4983-89c2-8ef847390ebf None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:11.944642 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d5efe-19be-4983-89c2-8ef847390ebf None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:11.945245 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d5efe-19be-4983-89c2-8ef847390ebf None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:11.947306 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 517/1027] 10.222.0.40 () {54 vars in 921 bytes} [Sun Oct 30 00:48:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:48:11.952519 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1287c8b-830f-418f-9873-795a87d65c6f None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:11.952961 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1287c8b-830f-418f-9873-795a87d65c6f None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:11.953064 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1287c8b-830f-418f-9873-795a87d65c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:12.052777 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-d1287c8b-830f-418f-9873-795a87d65c6f None None] MFA Rules not processed for user `d7f009bdf1d24ee4b879db926b8d44cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:12.062281 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-d1287c8b-830f-418f-9873-795a87d65c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:12.098900 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:12.197500 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 511/1028] 10.222.0.40 () {58 vars in 1018 bytes} [Sun Oct 30 00:48:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:16.314311 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1a969-f967-4785-8982-3184ce126fa3 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:16.314876 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1a969-f967-4785-8982-3184ce126fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:16.314876 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1a969-f967-4785-8982-3184ce126fa3 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:16.316251 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 518/1029] 10.222.0.40 () {54 vars in 921 bytes} [Sun Oct 30 00:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:48:16.322244 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dae2af-e9ff-4aa4-b9c8-2eded5b95c90 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:16.322698 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dae2af-e9ff-4aa4-b9c8-2eded5b95c90 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:16.322991 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dae2af-e9ff-4aa4-b9c8-2eded5b95c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:16.410491 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-b0dae2af-e9ff-4aa4-b9c8-2eded5b95c90 None None] MFA Rules not processed for user `d7f009bdf1d24ee4b879db926b8d44cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:16.412008 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-b0dae2af-e9ff-4aa4-b9c8-2eded5b95c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:16.487548 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:16.528233 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 512/1030] 10.222.0.40 () {58 vars in 1018 bytes} [Sun Oct 30 00:48:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:17.895727 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae29f86-50ab-449d-90b1-9cb6421301fe None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:17.896286 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae29f86-50ab-449d-90b1-9cb6421301fe None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:17.896286 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae29f86-50ab-449d-90b1-9cb6421301fe None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:17.897624 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 519/1031] 10.222.0.40 () {54 vars in 921 bytes} [Sun Oct 30 00:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:48:17.902895 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783c4cd-28b6-4518-ac6d-d913007fa80f None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:17.903287 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783c4cd-28b6-4518-ac6d-d913007fa80f None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:17.903561 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783c4cd-28b6-4518-ac6d-d913007fa80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:17.980566 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-7783c4cd-28b6-4518-ac6d-d913007fa80f None None] MFA Rules not processed for user `d7f009bdf1d24ee4b879db926b8d44cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:17.981729 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-7783c4cd-28b6-4518-ac6d-d913007fa80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:18.090246 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 513/1032] 10.222.0.40 () {58 vars in 1018 bytes} [Sun Oct 30 00:48:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:21.612308 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331847b-6f51-4a11-861a-dd9e5deefef5 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:21.612840 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331847b-6f51-4a11-861a-dd9e5deefef5 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:21.612840 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331847b-6f51-4a11-861a-dd9e5deefef5 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:21.614363 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 520/1033] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:48:21.619778 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e5a2f-c70d-4288-af03-d6f91a257923 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:21.620201 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e5a2f-c70d-4288-af03-d6f91a257923 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:21.620327 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e5a2f-c70d-4288-af03-d6f91a257923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:21.658703 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:21.695085 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-fd5e5a2f-c70d-4288-af03-d6f91a257923 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:21.696825 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-fd5e5a2f-c70d-4288-af03-d6f91a257923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:21.801420 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 514/1034] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:22.099903 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08f648-7817-4fb1-965c-542465ea09cc None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:22.101181 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08f648-7817-4fb1-965c-542465ea09cc None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:22.101846 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08f648-7817-4fb1-965c-542465ea09cc None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:22.104354 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 521/1035] 10.222.0.40 () {54 vars in 961 bytes} [Sun Oct 30 00:48:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:48:22.114874 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb95cee-3bb0-4863-97f2-1247a0b9e577 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:22.115662 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb95cee-3bb0-4863-97f2-1247a0b9e577 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:22.116610 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb95cee-3bb0-4863-97f2-1247a0b9e577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:22.200469 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-3fb95cee-3bb0-4863-97f2-1247a0b9e577 None None] MFA Rules not processed for user `4237b425d9fa4a60b10802e5b108d542`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:22.201936 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-3fb95cee-3bb0-4863-97f2-1247a0b9e577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:22.256616 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:22.331187 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 515/1036] 10.222.0.40 () {58 vars in 1058 bytes} [Sun Oct 30 00:48:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:22.339094 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08f648-7817-4fb1-965c-542465ea09cc None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:22.340714 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-af08f648-7817-4fb1-965c-542465ea09cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:22.500789 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08f648-7817-4fb1-965c-542465ea09cc None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:22.577127 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:22.622281 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d16a6-0f41-4dca-9c4a-6c4265888c36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:22.622947 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d16a6-0f41-4dca-9c4a-6c4265888c36 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:22.623201 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d16a6-0f41-4dca-9c4a-6c4265888c36 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:22.623313 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d16a6-0f41-4dca-9c4a-6c4265888c36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:22.624931 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e25d16a6-0f41-4dca-9c4a-6c4265888c36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:22.728483 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d16a6-0f41-4dca-9c4a-6c4265888c36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:22.730104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d16a6-0f41-4dca-9c4a-6c4265888c36 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:22.749845 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 522/1037] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:25.130166 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39435659-2a82-4df5-8953-cfff2ac1cd1a None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:25.130606 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39435659-2a82-4df5-8953-cfff2ac1cd1a None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:25.130853 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39435659-2a82-4df5-8953-cfff2ac1cd1a None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:25.132478 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 516/1038] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:48:25.137435 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415db21d-36b8-41eb-8340-67fc54345729 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:25.137901 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415db21d-36b8-41eb-8340-67fc54345729 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:25.138056 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415db21d-36b8-41eb-8340-67fc54345729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:25.209852 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-415db21d-36b8-41eb-8340-67fc54345729 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:25.211755 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-415db21d-36b8-41eb-8340-67fc54345729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:25.251120 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:25.334837 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 523/1039] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:25.622079 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39435659-2a82-4df5-8953-cfff2ac1cd1a None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:25.623882 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-39435659-2a82-4df5-8953-cfff2ac1cd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:25.852424 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39435659-2a82-4df5-8953-cfff2ac1cd1a None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:25.862496 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:25.973935 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b446c8d-032e-4278-a112-f2156a02582a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:25.974460 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b446c8d-032e-4278-a112-f2156a02582a service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:25.974739 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b446c8d-032e-4278-a112-f2156a02582a service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:25.975014 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b446c8d-032e-4278-a112-f2156a02582a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:25.976648 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9b446c8d-032e-4278-a112-f2156a02582a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:26.069773 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b446c8d-032e-4278-a112-f2156a02582a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:26.071898 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b446c8d-032e-4278-a112-f2156a02582a service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:26.090344 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 517/1040] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:28.576134 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7c6fc-5c71-4734-93f6-615b179db5e1 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:28.576651 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7c6fc-5c71-4734-93f6-615b179db5e1 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:28.576651 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7c6fc-5c71-4734-93f6-615b179db5e1 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:28.577954 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 524/1041] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:48:28.583266 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea38785-ea05-4edc-a49a-6934caa650d4 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:28.583686 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea38785-ea05-4edc-a49a-6934caa650d4 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:28.583857 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea38785-ea05-4edc-a49a-6934caa650d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:28.599811 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:28.654452 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-eea38785-ea05-4edc-a49a-6934caa650d4 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:28.655652 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-eea38785-ea05-4edc-a49a-6934caa650d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:28.757696 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 518/1042] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:29.046484 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c8c45-bc65-470f-83ee-c694c61e9fc5 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:29.046766 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c8c45-bc65-470f-83ee-c694c61e9fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:29.047047 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c8c45-bc65-470f-83ee-c694c61e9fc5 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:29.048435 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 525/1043] 10.222.0.40 () {54 vars in 961 bytes} [Sun Oct 30 00:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:48:29.053921 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2933e81-e3a8-4f6e-9123-01f4aa8c7167 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:29.054204 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2933e81-e3a8-4f6e-9123-01f4aa8c7167 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:29.054479 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2933e81-e3a8-4f6e-9123-01f4aa8c7167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:29.132196 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-c2933e81-e3a8-4f6e-9123-01f4aa8c7167 None None] MFA Rules not processed for user `4237b425d9fa4a60b10802e5b108d542`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:29.133937 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c2933e81-e3a8-4f6e-9123-01f4aa8c7167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:29.170887 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:29.260965 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 519/1044] 10.222.0.40 () {58 vars in 1058 bytes} [Sun Oct 30 00:48:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:29.268575 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c8c45-bc65-470f-83ee-c694c61e9fc5 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:29.270101 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d96c8c45-bc65-470f-83ee-c694c61e9fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:29.431258 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c8c45-bc65-470f-83ee-c694c61e9fc5 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:29.452170 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:29.555228 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a1ceb-e3dc-4ecc-8c7e-39014f46e182 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:29.555765 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a1ceb-e3dc-4ecc-8c7e-39014f46e182 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:29.556041 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a1ceb-e3dc-4ecc-8c7e-39014f46e182 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:29.556310 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a1ceb-e3dc-4ecc-8c7e-39014f46e182 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:29.558113 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-792a1ceb-e3dc-4ecc-8c7e-39014f46e182 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:29.655443 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a1ceb-e3dc-4ecc-8c7e-39014f46e182 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:29.657031 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a1ceb-e3dc-4ecc-8c7e-39014f46e182 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:29.665614 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0941680-053b-4652-bcb8-d2650b414992 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:29.666741 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0941680-053b-4652-bcb8-d2650b414992 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:29.667508 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0941680-053b-4652-bcb8-d2650b414992 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:29.670171 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 520/1045] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:48:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:48:29.677420 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 526/1046] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:29.679215 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f60f98-6841-409f-9dcc-97a4cacc3b90 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:29.679503 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f60f98-6841-409f-9dcc-97a4cacc3b90 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:29.679842 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f60f98-6841-409f-9dcc-97a4cacc3b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:29.754226 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-50f60f98-6841-409f-9dcc-97a4cacc3b90 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:29.755534 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-50f60f98-6841-409f-9dcc-97a4cacc3b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:29.875787 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:29.889249 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 521/1047] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:30.185469 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd259203-70f0-4c1a-a3cb-5feee1e25c53 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:30.185742 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd259203-70f0-4c1a-a3cb-5feee1e25c53 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:30.186014 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd259203-70f0-4c1a-a3cb-5feee1e25c53 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:30.187493 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 527/1048] 10.222.0.40 () {54 vars in 963 bytes} [Sun Oct 30 00:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:48:30.192270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363789f0-cef6-4acd-9f4f-1f1f8f695bfe None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:30.192559 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363789f0-cef6-4acd-9f4f-1f1f8f695bfe None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:30.192830 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363789f0-cef6-4acd-9f4f-1f1f8f695bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:30.273751 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-363789f0-cef6-4acd-9f4f-1f1f8f695bfe None None] MFA Rules not processed for user `0dfd57a56ebe41ebb2b836d1ab03e334`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:30.275075 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-363789f0-cef6-4acd-9f4f-1f1f8f695bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:30.356162 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 522/1049] 10.222.0.40 () {58 vars in 1060 bytes} [Sun Oct 30 00:48:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:30.369497 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd259203-70f0-4c1a-a3cb-5feee1e25c53 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:30.371105 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-dd259203-70f0-4c1a-a3cb-5feee1e25c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:30.400683 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:30.481220 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd259203-70f0-4c1a-a3cb-5feee1e25c53 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:30.558347 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ec17e-6ae3-469c-905d-46745a49c79c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dfd57a56ebe41ebb2b836d1ab03e334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:30.558943 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ec17e-6ae3-469c-905d-46745a49c79c service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:30.559216 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ec17e-6ae3-469c-905d-46745a49c79c service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:30.559482 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ec17e-6ae3-469c-905d-46745a49c79c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:30.561212 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-981ec17e-6ae3-469c-905d-46745a49c79c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:30.658986 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:30.706238 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ec17e-6ae3-469c-905d-46745a49c79c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:30.707646 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ec17e-6ae3-469c-905d-46745a49c79c service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:30.729741 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 528/1050] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:31.894624 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f1242-ad9e-4e04-8a5f-f329352463cb None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:31.895155 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f1242-ad9e-4e04-8a5f-f329352463cb None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:31.895155 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f1242-ad9e-4e04-8a5f-f329352463cb None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:31.896508 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 523/1051] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:48:31.902555 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9156a-b96a-4103-8f94-179cd5c28909 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:31.902969 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9156a-b96a-4103-8f94-179cd5c28909 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:31.903104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9156a-b96a-4103-8f94-179cd5c28909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:31.968831 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-29c9156a-b96a-4103-8f94-179cd5c28909 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:31.969996 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-29c9156a-b96a-4103-8f94-179cd5c28909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:32.068801 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 529/1052] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:32.358202 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f1242-ad9e-4e04-8a5f-f329352463cb None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:32.359856 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-469f1242-ad9e-4e04-8a5f-f329352463cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:32.455274 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:32.521685 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f1242-ad9e-4e04-8a5f-f329352463cb None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:32.641648 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda99d2f-f7aa-4886-a5a9-31a3c8d774a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:32.642161 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda99d2f-f7aa-4886-a5a9-31a3c8d774a9 service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:32.642433 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda99d2f-f7aa-4886-a5a9-31a3c8d774a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:32.642702 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda99d2f-f7aa-4886-a5a9-31a3c8d774a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:32.644280 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-bda99d2f-f7aa-4886-a5a9-31a3c8d774a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:32.700793 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:32.745160 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda99d2f-f7aa-4886-a5a9-31a3c8d774a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:32.746783 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda99d2f-f7aa-4886-a5a9-31a3c8d774a9 service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:32.767095 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 524/1053] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:34.972398 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d76a80-0e88-4040-9a4e-eff353717e1e None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:34.973252 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d76a80-0e88-4040-9a4e-eff353717e1e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:34.973673 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d76a80-0e88-4040-9a4e-eff353717e1e None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:34.975193 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 530/1054] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:48:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:48:34.980773 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b1975-fe4a-4bff-b4fc-9de22d369d25 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:34.981185 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b1975-fe4a-4bff-b4fc-9de22d369d25 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:34.981389 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b1975-fe4a-4bff-b4fc-9de22d369d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:35.050097 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-cd7b1975-fe4a-4bff-b4fc-9de22d369d25 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:35.051293 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-cd7b1975-fe4a-4bff-b4fc-9de22d369d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:35.155966 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 525/1055] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:48:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:35.451838 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d76a80-0e88-4040-9a4e-eff353717e1e None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:35.453497 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c0d76a80-0e88-4040-9a4e-eff353717e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:35.499999 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:35.621881 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d76a80-0e88-4040-9a4e-eff353717e1e None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:35.742597 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:35.749363 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92595a44-3799-4ecf-96e0-ef8c02e5da05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:35.749954 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92595a44-3799-4ecf-96e0-ef8c02e5da05 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:35.750238 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92595a44-3799-4ecf-96e0-ef8c02e5da05 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:35.750508 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92595a44-3799-4ecf-96e0-ef8c02e5da05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:35.752233 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-92595a44-3799-4ecf-96e0-ef8c02e5da05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:35.859632 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92595a44-3799-4ecf-96e0-ef8c02e5da05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:35.861228 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92595a44-3799-4ecf-96e0-ef8c02e5da05 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:35.880372 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 531/1056] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:38.179624 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5d0af-9141-4de4-8eda-82af05c03d37 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:38.180119 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5d0af-9141-4de4-8eda-82af05c03d37 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:38.180378 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5d0af-9141-4de4-8eda-82af05c03d37 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:38.181996 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 526/1057] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:48:38.187688 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f62418-587e-4eda-ac42-53c9df155ae0 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:38.188124 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f62418-587e-4eda-ac42-53c9df155ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:38.188468 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f62418-587e-4eda-ac42-53c9df155ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:38.329126 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-90f62418-587e-4eda-ac42-53c9df155ae0 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:38.331145 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-90f62418-587e-4eda-ac42-53c9df155ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:38.406942 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:38.441778 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 532/1058] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:38.731477 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5d0af-9141-4de4-8eda-82af05c03d37 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:38.733414 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-eef5d0af-9141-4de4-8eda-82af05c03d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:38.769727 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:38.916888 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5d0af-9141-4de4-8eda-82af05c03d37 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:39.031189 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:39.048940 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a6761-8f77-4700-8b3e-792e92cd70d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:39.049583 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a6761-8f77-4700-8b3e-792e92cd70d0 service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:39.049856 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a6761-8f77-4700-8b3e-792e92cd70d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:39.050120 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a6761-8f77-4700-8b3e-792e92cd70d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:39.051734 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-678a6761-8f77-4700-8b3e-792e92cd70d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:39.145259 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a6761-8f77-4700-8b3e-792e92cd70d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:39.146844 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a6761-8f77-4700-8b3e-792e92cd70d0 service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:39.166592 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 527/1059] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:41.828957 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60768dfd-45d4-4c53-9af9-11482013a52c None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:41.829558 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60768dfd-45d4-4c53-9af9-11482013a52c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:41.829558 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60768dfd-45d4-4c53-9af9-11482013a52c None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:41.830897 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 533/1060] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:48:41.837516 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5feb7-4a22-4471-9cec-4eab012ad959 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:41.837944 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5feb7-4a22-4471-9cec-4eab012ad959 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:41.838065 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5feb7-4a22-4471-9cec-4eab012ad959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:41.906531 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-6cb5feb7-4a22-4471-9cec-4eab012ad959 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:41.907807 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-6cb5feb7-4a22-4471-9cec-4eab012ad959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:41.973560 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:42.019519 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 528/1061] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:42.383871 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60768dfd-45d4-4c53-9af9-11482013a52c None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:42.385422 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-60768dfd-45d4-4c53-9af9-11482013a52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:42.536901 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60768dfd-45d4-4c53-9af9-11482013a52c None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:42.591586 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:42.658924 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f3ae6-6c5f-421b-8d29-ca7ee3b4231e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:42.659528 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f3ae6-6c5f-421b-8d29-ca7ee3b4231e service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:42.659806 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f3ae6-6c5f-421b-8d29-ca7ee3b4231e service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:42.660076 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f3ae6-6c5f-421b-8d29-ca7ee3b4231e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:42.665673 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c47f3ae6-6c5f-421b-8d29-ca7ee3b4231e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:42.762308 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f3ae6-6c5f-421b-8d29-ca7ee3b4231e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:42.763944 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f3ae6-6c5f-421b-8d29-ca7ee3b4231e service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:42.784887 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 534/1062] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:48:45.000301 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd3cc7-81f0-4481-8bf0-d2bd0aeaad72 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:45.000937 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd3cc7-81f0-4481-8bf0-d2bd0aeaad72 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:45.000937 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd3cc7-81f0-4481-8bf0-d2bd0aeaad72 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:45.002235 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 529/1063] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:48:45.008164 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8aa5e-cd95-47e1-897a-4386d377be43 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:45.008629 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8aa5e-cd95-47e1-897a-4386d377be43 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:45.008732 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8aa5e-cd95-47e1-897a-4386d377be43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:45.079948 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-9cb8aa5e-cd95-47e1-897a-4386d377be43 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:45.081156 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9cb8aa5e-cd95-47e1-897a-4386d377be43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:45.090079 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:45.179018 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 535/1064] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:45.471369 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd3cc7-81f0-4481-8bf0-d2bd0aeaad72 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:45.473005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-0cdd3cc7-81f0-4481-8bf0-d2bd0aeaad72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:45.618614 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd3cc7-81f0-4481-8bf0-d2bd0aeaad72 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:45.668740 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:45.736152 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c5853-c56a-461f-abfd-759ea1479341 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:45.736766 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c5853-c56a-461f-abfd-759ea1479341 service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:45.737037 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c5853-c56a-461f-abfd-759ea1479341 service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:45.737334 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c5853-c56a-461f-abfd-759ea1479341 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:45.738918 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ed5c5853-c56a-461f-abfd-759ea1479341 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:45.830242 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c5853-c56a-461f-abfd-759ea1479341 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:45.831822 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c5853-c56a-461f-abfd-759ea1479341 service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:45.850764 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 530/1065] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:46.261641 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1df7e-aa23-4ddc-ac00-13cdd70a4ff3 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:46.262195 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1df7e-aa23-4ddc-ac00-13cdd70a4ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:46.262195 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1df7e-aa23-4ddc-ac00-13cdd70a4ff3 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:46.263716 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 536/1066] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:48:46.269356 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea31de-89e7-4edc-b2a8-ff86d17bae1b None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:46.269780 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea31de-89e7-4edc-b2a8-ff86d17bae1b None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:46.270034 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea31de-89e7-4edc-b2a8-ff86d17bae1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:46.335557 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:46.338564 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-d8ea31de-89e7-4edc-b2a8-ff86d17bae1b None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:46.340322 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-d8ea31de-89e7-4edc-b2a8-ff86d17bae1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:46.441348 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 531/1067] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:46.743355 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05deab50-5119-497a-a983-6adbbdb7b557 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:46.743756 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05deab50-5119-497a-a983-6adbbdb7b557 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:46.744106 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05deab50-5119-497a-a983-6adbbdb7b557 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:46.745488 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 537/1068] 10.222.0.40 () {54 vars in 962 bytes} [Sun Oct 30 00:48:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:48:46.750798 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb9389-498d-4eb4-9214-c24e5d00292c None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:46.751087 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb9389-498d-4eb4-9214-c24e5d00292c None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:46.751358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb9389-498d-4eb4-9214-c24e5d00292c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:46.830036 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-49eb9389-498d-4eb4-9214-c24e5d00292c None None] MFA Rules not processed for user `507ae56497684fc08f05c65a3c23e898`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:46.831241 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-49eb9389-498d-4eb4-9214-c24e5d00292c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:46.904140 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:46.910763 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 532/1069] 10.222.0.40 () {58 vars in 1059 bytes} [Sun Oct 30 00:48:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:46.918539 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05deab50-5119-497a-a983-6adbbdb7b557 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:46.920033 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-05deab50-5119-497a-a983-6adbbdb7b557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:47.024400 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05deab50-5119-497a-a983-6adbbdb7b557 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:47.063236 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:47.099709 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace60075-c0e5-4429-bc27-277c4a620122 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ae56497684fc08f05c65a3c23e898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:47.100340 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace60075-c0e5-4429-bc27-277c4a620122 service glance] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:47.100615 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace60075-c0e5-4429-bc27-277c4a620122 service glance] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:47.100884 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace60075-c0e5-4429-bc27-277c4a620122 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:47.103073 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ace60075-c0e5-4429-bc27-277c4a620122 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:47.217935 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace60075-c0e5-4429-bc27-277c4a620122 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:47.219372 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace60075-c0e5-4429-bc27-277c4a620122 service glance] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:47.237521 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 538/1070] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:48.018501 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2eb61-be54-40fc-bfea-90be3399fd85 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:48.019004 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2eb61-be54-40fc-bfea-90be3399fd85 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:48.019123 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2eb61-be54-40fc-bfea-90be3399fd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:48.046992 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c69087-6c4c-457f-b97f-cdd6f2556154 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:48.047527 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c69087-6c4c-457f-b97f-cdd6f2556154 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:48.047527 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c69087-6c4c-457f-b97f-cdd6f2556154 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:48.048870 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 539/1071] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:48:48.053944 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f86f8-8d38-4909-b165-8337da4aeae7 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:48.054222 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f86f8-8d38-4909-b165-8337da4aeae7 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:48.055052 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f86f8-8d38-4909-b165-8337da4aeae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:48.091637 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-2dc2eb61-be54-40fc-bfea-90be3399fd85 None None] MFA Rules not processed for user `c625c9434922494aa868f1a5511963f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:48.092843 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-2dc2eb61-be54-40fc-bfea-90be3399fd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:48.121973 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-891f86f8-8d38-4909-b165-8337da4aeae7 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:48.123172 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-891f86f8-8d38-4909-b165-8337da4aeae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:48.141105 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:48.179777 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 533/1072] 10.222.0.40 () {58 vars in 1009 bytes} [Sun Oct 30 00:48:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:48.222308 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 540/1073] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:48:48.226564 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195a0f5-8992-4333-98f8-59e84152e654 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:48.226853 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195a0f5-8992-4333-98f8-59e84152e654 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:48.227331 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195a0f5-8992-4333-98f8-59e84152e654 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:48.228669 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 534/1074] 10.222.0.40 () {54 vars in 943 bytes} [Sun Oct 30 00:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:48:48.234932 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784c660-f6c6-428b-9997-2669ecf0522b None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:48.235219 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784c660-f6c6-428b-9997-2669ecf0522b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:48.235491 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784c660-f6c6-428b-9997-2669ecf0522b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:48.311740 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-0784c660-f6c6-428b-9997-2669ecf0522b None None] MFA Rules not processed for user `b996b01e045b4034be43a907536079c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:48.312945 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0784c660-f6c6-428b-9997-2669ecf0522b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:48.404208 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:48.435868 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 541/1075] 10.222.0.40 () {58 vars in 1040 bytes} [Sun Oct 30 00:48:48 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:48.446143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195a0f5-8992-4333-98f8-59e84152e654 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:48.447900 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-4195a0f5-8992-4333-98f8-59e84152e654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:48.514616 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784c660-f6c6-428b-9997-2669ecf0522b None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:48.516713 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0784c660-f6c6-428b-9997-2669ecf0522b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:48.540408 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:48.591928 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195a0f5-8992-4333-98f8-59e84152e654 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:48.617140 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784c660-f6c6-428b-9997-2669ecf0522b None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:48.699532 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008f9a9-7f6f-41a7-9be4-819565cbbbfc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b996b01e045b4034be43a907536079c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:48.700051 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008f9a9-7f6f-41a7-9be4-819565cbbbfc service swift] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:48.700328 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008f9a9-7f6f-41a7-9be4-819565cbbbfc service swift] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:48.700596 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008f9a9-7f6f-41a7-9be4-819565cbbbfc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:48.702267 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8008f9a9-7f6f-41a7-9be4-819565cbbbfc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:48.728899 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:48.740134 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb13a7e-2def-4a8f-b568-8b65fbed2056 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:48.740733 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb13a7e-2def-4a8f-b568-8b65fbed2056 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:48.741034 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb13a7e-2def-4a8f-b568-8b65fbed2056 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:48.741323 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb13a7e-2def-4a8f-b568-8b65fbed2056 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:48.742945 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-1eb13a7e-2def-4a8f-b568-8b65fbed2056 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:48.771992 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:48.788391 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008f9a9-7f6f-41a7-9be4-819565cbbbfc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:48.790528 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008f9a9-7f6f-41a7-9be4-819565cbbbfc service swift] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:48.798785 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 535/1076] 10.222.0.40 () {60 vars in 1384 bytes} [Sun Oct 30 00:48:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 00:48:48.837927 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb13a7e-2def-4a8f-b568-8b65fbed2056 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:48.839641 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb13a7e-2def-4a8f-b568-8b65fbed2056 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:48.858448 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 542/1077] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:48:51.161642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31137371-4fd6-4e30-a101-06b4f04b0941 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:51.162188 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31137371-4fd6-4e30-a101-06b4f04b0941 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:51.162188 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31137371-4fd6-4e30-a101-06b4f04b0941 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:51.163506 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 536/1078] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:48:51.169044 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b9b7a-4251-4b65-a989-30a1b4b37a49 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:51.169549 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b9b7a-4251-4b65-a989-30a1b4b37a49 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:51.169904 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b9b7a-4251-4b65-a989-30a1b4b37a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:51.239666 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a02b9b7a-4251-4b65-a989-30a1b4b37a49 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:51.241016 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a02b9b7a-4251-4b65-a989-30a1b4b37a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:51.311960 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:51.352824 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 543/1079] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:51.649179 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31137371-4fd6-4e30-a101-06b4f04b0941 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:51.650762 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-31137371-4fd6-4e30-a101-06b4f04b0941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:51.823316 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31137371-4fd6-4e30-a101-06b4f04b0941 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:51.887738 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:51.949455 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd6498-ce8b-4700-a7b1-91954130fdb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:51.950057 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd6498-ce8b-4700-a7b1-91954130fdb4 service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:51.950328 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd6498-ce8b-4700-a7b1-91954130fdb4 service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:51.950693 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd6498-ce8b-4700-a7b1-91954130fdb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:51.952582 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-b7bd6498-ce8b-4700-a7b1-91954130fdb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:52.077645 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd6498-ce8b-4700-a7b1-91954130fdb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:52.079500 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd6498-ce8b-4700-a7b1-91954130fdb4 service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:52.105374 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 537/1080] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:54.324062 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccbc86-bc6d-461c-b72e-0c0d44ae0739 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:54.324577 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccbc86-bc6d-461c-b72e-0c0d44ae0739 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:54.324577 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccbc86-bc6d-461c-b72e-0c0d44ae0739 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:54.325874 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 544/1081] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:48:54.331123 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71443b8a-796b-4a52-a89d-776c2ba5f454 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:54.331582 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71443b8a-796b-4a52-a89d-776c2ba5f454 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:54.331679 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71443b8a-796b-4a52-a89d-776c2ba5f454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:54.404845 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-71443b8a-796b-4a52-a89d-776c2ba5f454 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:54.406082 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-71443b8a-796b-4a52-a89d-776c2ba5f454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:54.430331 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:54.513575 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 538/1082] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:54.802591 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccbc86-bc6d-461c-b72e-0c0d44ae0739 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:54.804469 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-29ccbc86-bc6d-461c-b72e-0c0d44ae0739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:54.959444 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccbc86-bc6d-461c-b72e-0c0d44ae0739 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:55.016776 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:55.090166 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4bf89-5c32-4486-b809-4fdfc88adc63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:55.090775 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4bf89-5c32-4486-b809-4fdfc88adc63 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:55.091044 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4bf89-5c32-4486-b809-4fdfc88adc63 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:55.091314 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4bf89-5c32-4486-b809-4fdfc88adc63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:55.092915 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d0e4bf89-5c32-4486-b809-4fdfc88adc63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:55.193884 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4bf89-5c32-4486-b809-4fdfc88adc63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:55.195510 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4bf89-5c32-4486-b809-4fdfc88adc63 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:55.215355 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 545/1083] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:57.515161 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0ed32-8881-4540-a262-83a304747211 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:57.515696 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0ed32-8881-4540-a262-83a304747211 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:57.515816 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0ed32-8881-4540-a262-83a304747211 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:57.517257 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 539/1084] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:48:57.522450 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060271d-a43c-463f-b7e4-6103b8ef04f9 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:57.522873 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060271d-a43c-463f-b7e4-6103b8ef04f9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:57.526355 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060271d-a43c-463f-b7e4-6103b8ef04f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:57.593598 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-b060271d-a43c-463f-b7e4-6103b8ef04f9 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:57.594827 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b060271d-a43c-463f-b7e4-6103b8ef04f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:57.599583 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:57.721286 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 546/1085] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:58.008613 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0ed32-8881-4540-a262-83a304747211 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:58.010155 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-eee0ed32-8881-4540-a262-83a304747211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:58.177515 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0ed32-8881-4540-a262-83a304747211 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:58.181711 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:58.304590 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ae6d1-2bef-4acb-a55b-b6c78de3c61d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:58.305183 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ae6d1-2bef-4acb-a55b-b6c78de3c61d service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:58.305512 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ae6d1-2bef-4acb-a55b-b6c78de3c61d service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:58.305788 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ae6d1-2bef-4acb-a55b-b6c78de3c61d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:58.307433 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-956ae6d1-2bef-4acb-a55b-b6c78de3c61d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:58.408063 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ae6d1-2bef-4acb-a55b-b6c78de3c61d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:58.409889 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ae6d1-2bef-4acb-a55b-b6c78de3c61d service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:58.428951 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 540/1086] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:07.706617 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=41 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:08.426255 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=96 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:11.300429 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafa3d3-9ad8-4215-b902-3755cec11fd6 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:11.301004 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafa3d3-9ad8-4215-b902-3755cec11fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:11.301004 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafa3d3-9ad8-4215-b902-3755cec11fd6 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:11.302352 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 547/1087] 10.222.0.40 () {54 vars in 918 bytes} [Sun Oct 30 00:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:49:11.308011 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c75c7-cd4b-4246-ba01-8e14d2764747 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:11.308445 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c75c7-cd4b-4246-ba01-8e14d2764747 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:11.308544 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c75c7-cd4b-4246-ba01-8e14d2764747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:11.383334 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-027c75c7-cd4b-4246-ba01-8e14d2764747 None None] MFA Rules not processed for user `d7f009bdf1d24ee4b879db926b8d44cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:11.385113 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-027c75c7-cd4b-4246-ba01-8e14d2764747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:11.488288 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 541/1088] 10.222.0.40 () {58 vars in 1015 bytes} [Sun Oct 30 00:49:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:11.502938 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d19df-2221-4b6c-bb7a-4464080cae24 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:11.503217 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d19df-2221-4b6c-bb7a-4464080cae24 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:11.503488 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d19df-2221-4b6c-bb7a-4464080cae24 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:11.504810 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 548/1089] 10.222.0.40 () {54 vars in 918 bytes} [Sun Oct 30 00:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:49:11.509346 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b57087-7aed-4249-a4ef-d3e169f01813 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:11.510171 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b57087-7aed-4249-a4ef-d3e169f01813 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:11.510443 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b57087-7aed-4249-a4ef-d3e169f01813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:11.582619 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:11.585827 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-97b57087-7aed-4249-a4ef-d3e169f01813 None None] MFA Rules not processed for user `4237b425d9fa4a60b10802e5b108d542`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:11.587667 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-97b57087-7aed-4249-a4ef-d3e169f01813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:11.703086 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 542/1090] 10.222.0.40 () {58 vars in 1015 bytes} [Sun Oct 30 00:49:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:49:14.260086 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b8a3f-f415-405a-abd9-986a080e39dd None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:14.260696 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b8a3f-f415-405a-abd9-986a080e39dd None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:14.260696 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b8a3f-f415-405a-abd9-986a080e39dd None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:14.262044 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 549/1091] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 00:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:49:14.267241 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b913eeb-810d-44b3-9518-44b17c591d5b None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:14.267681 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b913eeb-810d-44b3-9518-44b17c591d5b None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:14.267796 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b913eeb-810d-44b3-9518-44b17c591d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:14.333293 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-2b913eeb-810d-44b3-9518-44b17c591d5b None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:14.334494 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-2b913eeb-810d-44b3-9518-44b17c591d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:14.388762 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:14.431179 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 543/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 00:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:14.717849 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b8a3f-f415-405a-abd9-986a080e39dd None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:14.719545 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ae7b8a3f-f415-405a-abd9-986a080e39dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:14.862995 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b8a3f-f415-405a-abd9-986a080e39dd None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:14.934147 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:14.974874 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f2f92-3362-459f-8a62-e66984b61e93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:14.975462 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f2f92-3362-459f-8a62-e66984b61e93 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:14.975738 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f2f92-3362-459f-8a62-e66984b61e93 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:14.976006 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f2f92-3362-459f-8a62-e66984b61e93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:14.977610 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7f9f2f92-3362-459f-8a62-e66984b61e93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:15.064631 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f2f92-3362-459f-8a62-e66984b61e93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:15.066230 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f2f92-3362-459f-8a62-e66984b61e93 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:15.084346 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 550/1093] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:16.209170 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2ee22-9de6-4a42-8db1-45bea899c244 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:16.209755 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2ee22-9de6-4a42-8db1-45bea899c244 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:16.209755 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2ee22-9de6-4a42-8db1-45bea899c244 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:16.211073 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 544/1094] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 00:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:49:16.216410 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553b73f-6146-4c4b-9ffd-eaf79e1f649f None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:16.216854 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553b73f-6146-4c4b-9ffd-eaf79e1f649f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:16.216979 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553b73f-6146-4c4b-9ffd-eaf79e1f649f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:16.291431 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-6553b73f-6146-4c4b-9ffd-eaf79e1f649f None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:16.292626 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6553b73f-6146-4c4b-9ffd-eaf79e1f649f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:16.318600 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:16.387477 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 551/1095] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 00:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:16.534756 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2ee22-9de6-4a42-8db1-45bea899c244 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:16.536271 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-76c2ee22-9de6-4a42-8db1-45bea899c244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:16.680656 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2ee22-9de6-4a42-8db1-45bea899c244 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:16.724905 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:16.796657 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8eddb-00ff-497f-a3b4-c59f2131b2a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:16.797201 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8eddb-00ff-497f-a3b4-c59f2131b2a4 service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:16.797498 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8eddb-00ff-497f-a3b4-c59f2131b2a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:16.797766 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8eddb-00ff-497f-a3b4-c59f2131b2a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:16.799379 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-beb8eddb-00ff-497f-a3b4-c59f2131b2a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:16.886365 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8eddb-00ff-497f-a3b4-c59f2131b2a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:16.887932 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8eddb-00ff-497f-a3b4-c59f2131b2a4 service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:16.905925 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 545/1096] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:18.019677 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4148396-d775-4790-826b-da69257adabc None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:18.020240 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4148396-d775-4790-826b-da69257adabc None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:18.020240 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4148396-d775-4790-826b-da69257adabc None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:18.021585 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 552/1097] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 00:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:49:18.027063 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353dfdf-1a95-44c4-9bb7-bfca278d8088 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:18.027489 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353dfdf-1a95-44c4-9bb7-bfca278d8088 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:18.027880 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353dfdf-1a95-44c4-9bb7-bfca278d8088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:18.081529 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:18.103461 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-1353dfdf-1a95-44c4-9bb7-bfca278d8088 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:18.104654 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-1353dfdf-1a95-44c4-9bb7-bfca278d8088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:18.199153 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 546/1098] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 00:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:18.347800 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4148396-d775-4790-826b-da69257adabc None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:18.349318 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c4148396-d775-4790-826b-da69257adabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:18.490175 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4148396-d775-4790-826b-da69257adabc None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:18.502425 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:18.601252 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4000d62-6657-4f76-aed7-3fc25a0c7c41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:18.601783 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4000d62-6657-4f76-aed7-3fc25a0c7c41 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:18.602055 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4000d62-6657-4f76-aed7-3fc25a0c7c41 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:18.602321 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4000d62-6657-4f76-aed7-3fc25a0c7c41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:18.604412 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c4000d62-6657-4f76-aed7-3fc25a0c7c41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:18.695000 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4000d62-6657-4f76-aed7-3fc25a0c7c41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:18.696571 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4000d62-6657-4f76-aed7-3fc25a0c7c41 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:18.713977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 553/1099] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:19.806033 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7261c-50b4-486c-9022-61582309e5ec None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:19.806601 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7261c-50b4-486c-9022-61582309e5ec None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:19.806601 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7261c-50b4-486c-9022-61582309e5ec None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:19.807906 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 547/1100] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 00:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:49:19.812776 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf285f32-6054-40aa-8392-755f2de4ccd4 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:19.813235 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf285f32-6054-40aa-8392-755f2de4ccd4 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:19.813377 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf285f32-6054-40aa-8392-755f2de4ccd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:19.832875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:19.888183 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-cf285f32-6054-40aa-8392-755f2de4ccd4 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:19.889400 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-cf285f32-6054-40aa-8392-755f2de4ccd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:19.984526 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 554/1101] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 00:49:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:20.134219 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7261c-50b4-486c-9022-61582309e5ec None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:20.135795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a3f7261c-50b4-486c-9022-61582309e5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:20.243835 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:20.279884 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7261c-50b4-486c-9022-61582309e5ec None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:20.390991 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497b717-c4c2-41cb-82cc-f49c7f05d959 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:20.391572 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497b717-c4c2-41cb-82cc-f49c7f05d959 service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:20.391843 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497b717-c4c2-41cb-82cc-f49c7f05d959 service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:20.392106 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497b717-c4c2-41cb-82cc-f49c7f05d959 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:20.393713 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-f497b717-c4c2-41cb-82cc-f49c7f05d959 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:20.469413 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:20.483756 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497b717-c4c2-41cb-82cc-f49c7f05d959 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:20.485370 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497b717-c4c2-41cb-82cc-f49c7f05d959 service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:20.503052 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 548/1102] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:21.602215 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a71a49-0fc2-4558-aa5c-d8fa2a712832 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:21.602740 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a71a49-0fc2-4558-aa5c-d8fa2a712832 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:21.602740 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a71a49-0fc2-4558-aa5c-d8fa2a712832 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:21.604499 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 555/1103] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 00:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:49:21.609321 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ff000-0c6a-48de-9013-7fe2593e6c8e None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:21.609700 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ff000-0c6a-48de-9013-7fe2593e6c8e None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:21.609861 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ff000-0c6a-48de-9013-7fe2593e6c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:21.686446 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-bd3ff000-0c6a-48de-9013-7fe2593e6c8e None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:21.687668 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-bd3ff000-0c6a-48de-9013-7fe2593e6c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:21.783142 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 549/1104] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 00:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:21.933382 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a71a49-0fc2-4558-aa5c-d8fa2a712832 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:21.934849 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-17a71a49-0fc2-4558-aa5c-d8fa2a712832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:22.019977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:22.081582 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a71a49-0fc2-4558-aa5c-d8fa2a712832 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:22.192912 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f433c71-00d5-4105-bf0f-235259278b5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:22.193447 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f433c71-00d5-4105-bf0f-235259278b5d service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:22.193721 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f433c71-00d5-4105-bf0f-235259278b5d service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:22.193986 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f433c71-00d5-4105-bf0f-235259278b5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:22.195559 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6f433c71-00d5-4105-bf0f-235259278b5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:22.241676 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:22.281984 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f433c71-00d5-4105-bf0f-235259278b5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:22.283623 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f433c71-00d5-4105-bf0f-235259278b5d service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:22.301680 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 556/1105] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:23.332199 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c7aed-efb5-400e-b71f-14fb0a28de60 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:23.332672 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c7aed-efb5-400e-b71f-14fb0a28de60 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:23.332789 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c7aed-efb5-400e-b71f-14fb0a28de60 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:23.334134 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 550/1106] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 00:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:49:23.339532 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a46bba-3257-4616-8f5e-e284b7ff9fb7 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:23.339951 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a46bba-3257-4616-8f5e-e284b7ff9fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:23.340105 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a46bba-3257-4616-8f5e-e284b7ff9fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:23.415310 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-d0a46bba-3257-4616-8f5e-e284b7ff9fb7 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:23.417044 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d0a46bba-3257-4616-8f5e-e284b7ff9fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:23.512213 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 557/1107] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 00:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:23.662921 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c7aed-efb5-400e-b71f-14fb0a28de60 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:23.664364 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-622c7aed-efb5-400e-b71f-14fb0a28de60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:23.714221 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:23.810344 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c7aed-efb5-400e-b71f-14fb0a28de60 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:23.921248 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b72015-da90-4617-b350-e6c15140b022 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:23.921789 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b72015-da90-4617-b350-e6c15140b022 service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:23.922061 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b72015-da90-4617-b350-e6c15140b022 service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:23.922328 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b72015-da90-4617-b350-e6c15140b022 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:23.923921 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-17b72015-da90-4617-b350-e6c15140b022 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:23.930655 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:24.014899 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b72015-da90-4617-b350-e6c15140b022 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:24.016487 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b72015-da90-4617-b350-e6c15140b022 service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:24.035086 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 551/1108] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:25.083495 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e32461-f9bd-49d1-9470-122faf93d46f None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:25.084038 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e32461-f9bd-49d1-9470-122faf93d46f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:25.084153 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e32461-f9bd-49d1-9470-122faf93d46f None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:25.085563 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 558/1109] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 00:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:49:25.091025 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33e896-6418-4ed3-8c2f-802a68415fda None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:25.091418 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33e896-6418-4ed3-8c2f-802a68415fda None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:25.091564 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33e896-6418-4ed3-8c2f-802a68415fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:25.166880 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-8f33e896-6418-4ed3-8c2f-802a68415fda None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:25.168086 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8f33e896-6418-4ed3-8c2f-802a68415fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:25.234908 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:25.264059 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 552/1110] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 00:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:25.415643 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e32461-f9bd-49d1-9470-122faf93d46f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:25.417118 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c6e32461-f9bd-49d1-9470-122faf93d46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:25.434600 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:25.560925 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e32461-f9bd-49d1-9470-122faf93d46f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:25.646770 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:25.676275 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd923e10-cec0-46dc-90cd-52c3e8bdffc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:25.676875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd923e10-cec0-46dc-90cd-52c3e8bdffc8 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:25.677148 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd923e10-cec0-46dc-90cd-52c3e8bdffc8 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:25.677446 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd923e10-cec0-46dc-90cd-52c3e8bdffc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:25.679035 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fd923e10-cec0-46dc-90cd-52c3e8bdffc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:25.769284 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd923e10-cec0-46dc-90cd-52c3e8bdffc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:25.770893 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd923e10-cec0-46dc-90cd-52c3e8bdffc8 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:25.790683 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 559/1111] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:26.823978 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba4f09-24b8-40b5-a8a5-7070ee31ae4f None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:26.824536 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba4f09-24b8-40b5-a8a5-7070ee31ae4f None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:26.824536 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba4f09-24b8-40b5-a8a5-7070ee31ae4f None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:26.825936 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 553/1112] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 00:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:49:26.830669 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c759e-2659-42c1-917a-f5849e042b4e None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:26.831121 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c759e-2659-42c1-917a-f5849e042b4e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:26.831226 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c759e-2659-42c1-917a-f5849e042b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:26.905715 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-618c759e-2659-42c1-917a-f5849e042b4e None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:26.906906 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-618c759e-2659-42c1-917a-f5849e042b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:26.947960 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:27.001863 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 560/1113] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 00:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:27.152128 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba4f09-24b8-40b5-a8a5-7070ee31ae4f None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:27.153957 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-47ba4f09-24b8-40b5-a8a5-7070ee31ae4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:27.298893 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba4f09-24b8-40b5-a8a5-7070ee31ae4f None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:27.353405 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:27.412451 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2146fe-f06c-467a-b6f7-201ad4719144 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:27.413040 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2146fe-f06c-467a-b6f7-201ad4719144 service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:27.413343 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2146fe-f06c-467a-b6f7-201ad4719144 service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:27.413614 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2146fe-f06c-467a-b6f7-201ad4719144 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:27.415202 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-2d2146fe-f06c-467a-b6f7-201ad4719144 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:27.503628 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2146fe-f06c-467a-b6f7-201ad4719144 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:27.505211 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2146fe-f06c-467a-b6f7-201ad4719144 service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:27.522934 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 554/1114] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:28.555404 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59298af-3917-417e-aa69-914ab3b8f954 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:28.555998 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59298af-3917-417e-aa69-914ab3b8f954 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:28.555998 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59298af-3917-417e-aa69-914ab3b8f954 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:28.557835 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 561/1115] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 00:49:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:49:28.563052 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9aef21-9c08-41cf-861d-f44ee64527fd None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:28.563479 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9aef21-9c08-41cf-861d-f44ee64527fd None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:28.563583 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9aef21-9c08-41cf-861d-f44ee64527fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:28.638446 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-9a9aef21-9c08-41cf-861d-f44ee64527fd None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:28.639654 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9a9aef21-9c08-41cf-861d-f44ee64527fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:28.641670 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:28.736002 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 555/1116] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 00:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:28.890196 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59298af-3917-417e-aa69-914ab3b8f954 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:28.891734 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a59298af-3917-417e-aa69-914ab3b8f954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:29.033164 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59298af-3917-417e-aa69-914ab3b8f954 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:29.061699 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:29.145306 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1157b-5d7a-4c0b-bb0d-961261ab6c4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:29.145853 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1157b-5d7a-4c0b-bb0d-961261ab6c4f service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:29.146127 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1157b-5d7a-4c0b-bb0d-961261ab6c4f service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:29.146396 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1157b-5d7a-4c0b-bb0d-961261ab6c4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:29.147975 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-54f1157b-5d7a-4c0b-bb0d-961261ab6c4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:29.234441 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1157b-5d7a-4c0b-bb0d-961261ab6c4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:29.236014 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1157b-5d7a-4c0b-bb0d-961261ab6c4f service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:29.253756 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 562/1117] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:31.323492 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881c1db-16f2-4d52-bc0b-efe7b5779265 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:31.324142 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881c1db-16f2-4d52-bc0b-efe7b5779265 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:31.324142 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881c1db-16f2-4d52-bc0b-efe7b5779265 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:31.325395 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 556/1118] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 00:49:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:49:31.330666 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69502a8-671b-40da-8fbb-46e1cf4e644b None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:31.331052 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69502a8-671b-40da-8fbb-46e1cf4e644b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:31.331150 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69502a8-671b-40da-8fbb-46e1cf4e644b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:31.371751 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:31.397261 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-c69502a8-671b-40da-8fbb-46e1cf4e644b None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:31.398461 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c69502a8-671b-40da-8fbb-46e1cf4e644b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:31.493458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 563/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 00:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:31.782378 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881c1db-16f2-4d52-bc0b-efe7b5779265 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:31.783916 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a881c1db-16f2-4d52-bc0b-efe7b5779265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:31.887837 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881c1db-16f2-4d52-bc0b-efe7b5779265 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:31.920749 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:31.961859 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a456f7c-f0fa-4e8d-8f5c-80706f47acc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:31.962439 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a456f7c-f0fa-4e8d-8f5c-80706f47acc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:31.963187 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a456f7c-f0fa-4e8d-8f5c-80706f47acc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:31.963456 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a456f7c-f0fa-4e8d-8f5c-80706f47acc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:31.965060 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-0a456f7c-f0fa-4e8d-8f5c-80706f47acc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:32.074960 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a456f7c-f0fa-4e8d-8f5c-80706f47acc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:32.076364 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a456f7c-f0fa-4e8d-8f5c-80706f47acc5 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:32.094771 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 557/1120] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:34.374370 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022edfb0-72be-4b4b-a78a-cb913839f360 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:34.374961 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022edfb0-72be-4b4b-a78a-cb913839f360 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:34.374961 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022edfb0-72be-4b4b-a78a-cb913839f360 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:34.376244 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 564/1121] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 00:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:49:34.381450 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86143c4b-2e9e-4cf4-ae46-f9a6a5772b20 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:34.381895 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86143c4b-2e9e-4cf4-ae46-f9a6a5772b20 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:34.381991 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86143c4b-2e9e-4cf4-ae46-f9a6a5772b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:34.447755 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-86143c4b-2e9e-4cf4-ae46-f9a6a5772b20 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:34.448963 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-86143c4b-2e9e-4cf4-ae46-f9a6a5772b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:34.461579 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:34.544462 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 558/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 00:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:34.832109 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022edfb0-72be-4b4b-a78a-cb913839f360 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:34.833699 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-022edfb0-72be-4b4b-a78a-cb913839f360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:34.935536 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022edfb0-72be-4b4b-a78a-cb913839f360 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:34.948432 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:35.008125 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a6d38-4418-4e59-9064-a4a630d2b052 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:35.008719 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a6d38-4418-4e59-9064-a4a630d2b052 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:35.008992 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a6d38-4418-4e59-9064-a4a630d2b052 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:35.009775 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a6d38-4418-4e59-9064-a4a630d2b052 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:35.011353 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d17a6d38-4418-4e59-9064-a4a630d2b052 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:35.117955 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a6d38-4418-4e59-9064-a4a630d2b052 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:35.119374 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a6d38-4418-4e59-9064-a4a630d2b052 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:35.137424 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 565/1123] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:37.558619 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d9966-f1c6-4993-95b5-7f3a1abe8e0c None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:37.559147 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d9966-f1c6-4993-95b5-7f3a1abe8e0c None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:37.559241 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d9966-f1c6-4993-95b5-7f3a1abe8e0c None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:37.560507 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 559/1124] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 00:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:49:37.565907 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de115f2-f03e-44e6-9e56-5629a21ee24e None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:37.566309 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de115f2-f03e-44e6-9e56-5629a21ee24e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:37.566448 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de115f2-f03e-44e6-9e56-5629a21ee24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:37.614007 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:37.632095 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-7de115f2-f03e-44e6-9e56-5629a21ee24e None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:37.633347 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7de115f2-f03e-44e6-9e56-5629a21ee24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:37.732760 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 566/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 00:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:38.021743 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d9966-f1c6-4993-95b5-7f3a1abe8e0c None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:38.023271 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-642d9966-f1c6-4993-95b5-7f3a1abe8e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:38.125737 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d9966-f1c6-4993-95b5-7f3a1abe8e0c None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:38.167006 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:38.200590 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7f449-cb19-46cd-bafc-069adbc8f73c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:38.201175 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7f449-cb19-46cd-bafc-069adbc8f73c service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:38.201481 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7f449-cb19-46cd-bafc-069adbc8f73c service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:38.201746 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7f449-cb19-46cd-bafc-069adbc8f73c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:38.203336 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-95c7f449-cb19-46cd-bafc-069adbc8f73c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:38.309548 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7f449-cb19-46cd-bafc-069adbc8f73c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:38.310881 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7f449-cb19-46cd-bafc-069adbc8f73c service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:38.329304 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 560/1126] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:40.589154 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9756688-b77c-490f-8d75-b365d43fdb6c None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:40.589707 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9756688-b77c-490f-8d75-b365d43fdb6c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:40.589825 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9756688-b77c-490f-8d75-b365d43fdb6c None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:40.591095 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 567/1127] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 00:49:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:49:40.596621 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3aa64-c174-4cb4-85f2-a8abd3845392 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:40.597013 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3aa64-c174-4cb4-85f2-a8abd3845392 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:40.597156 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3aa64-c174-4cb4-85f2-a8abd3845392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:40.660941 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-cfc3aa64-c174-4cb4-85f2-a8abd3845392 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:40.662255 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-cfc3aa64-c174-4cb4-85f2-a8abd3845392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:40.684373 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:40.759577 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 561/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 00:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:41.043401 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9756688-b77c-490f-8d75-b365d43fdb6c None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:41.044917 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f9756688-b77c-490f-8d75-b365d43fdb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:41.147976 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9756688-b77c-490f-8d75-b365d43fdb6c None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:41.168560 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:41.222222 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45f89c-4fc9-4447-9ce6-dd495eb750c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:41.222812 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45f89c-4fc9-4447-9ce6-dd495eb750c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:41.223083 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45f89c-4fc9-4447-9ce6-dd495eb750c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:41.223346 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45f89c-4fc9-4447-9ce6-dd495eb750c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:41.224910 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-de45f89c-4fc9-4447-9ce6-dd495eb750c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:41.333294 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45f89c-4fc9-4447-9ce6-dd495eb750c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:41.334643 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45f89c-4fc9-4447-9ce6-dd495eb750c3 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:41.352245 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 568/1129] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:43.555685 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8eddf1-d080-4a4a-b13a-489c4f7fb53d None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:43.556247 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8eddf1-d080-4a4a-b13a-489c4f7fb53d None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:43.556247 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8eddf1-d080-4a4a-b13a-489c4f7fb53d None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:43.558127 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 562/1130] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 00:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:49:43.563351 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a409c-d24c-4512-a030-aefbb1fc4fda None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:43.563774 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a409c-d24c-4512-a030-aefbb1fc4fda None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:43.563881 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a409c-d24c-4512-a030-aefbb1fc4fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:43.625979 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:43.628552 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-f92a409c-d24c-4512-a030-aefbb1fc4fda None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:43.630286 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f92a409c-d24c-4512-a030-aefbb1fc4fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:43.725742 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 569/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 00:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:44.010673 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8eddf1-d080-4a4a-b13a-489c4f7fb53d None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:44.012216 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-cb8eddf1-d080-4a4a-b13a-489c4f7fb53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:44.113387 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8eddf1-d080-4a4a-b13a-489c4f7fb53d None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:44.162242 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:44.186826 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2b288-1f6e-400a-b5d9-d396fd545812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:44.187407 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2b288-1f6e-400a-b5d9-d396fd545812 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:44.187675 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2b288-1f6e-400a-b5d9-d396fd545812 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:44.187935 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2b288-1f6e-400a-b5d9-d396fd545812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:44.189527 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-7aa2b288-1f6e-400a-b5d9-d396fd545812 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:44.293529 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2b288-1f6e-400a-b5d9-d396fd545812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:44.294859 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2b288-1f6e-400a-b5d9-d396fd545812 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:44.313443 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 563/1132] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:46.625883 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3730c1-2547-4d6b-a2f6-2af144d23de9 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:46.626467 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3730c1-2547-4d6b-a2f6-2af144d23de9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:46.626467 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3730c1-2547-4d6b-a2f6-2af144d23de9 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:46.627772 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 570/1133] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 00:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:49:46.633156 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb13af-b0f4-4470-8fa2-32c8b088bbeb None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:46.633587 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb13af-b0f4-4470-8fa2-32c8b088bbeb None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:46.633739 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb13af-b0f4-4470-8fa2-32c8b088bbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:46.699580 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-16cb13af-b0f4-4470-8fa2-32c8b088bbeb None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:46.700779 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-16cb13af-b0f4-4470-8fa2-32c8b088bbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:46.729328 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:46.795042 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 564/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 00:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:47.078262 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3730c1-2547-4d6b-a2f6-2af144d23de9 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:47.079513 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3b3730c1-2547-4d6b-a2f6-2af144d23de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:47.180706 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3730c1-2547-4d6b-a2f6-2af144d23de9 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:47.208324 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:47.252017 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b04027-1ce3-4e6a-9ea6-cca6a6245abe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:47.252603 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b04027-1ce3-4e6a-9ea6-cca6a6245abe service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:47.252877 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b04027-1ce3-4e6a-9ea6-cca6a6245abe service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:47.253143 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b04027-1ce3-4e6a-9ea6-cca6a6245abe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:47.254730 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-53b04027-1ce3-4e6a-9ea6-cca6a6245abe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:47.362515 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b04027-1ce3-4e6a-9ea6-cca6a6245abe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:47.363931 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b04027-1ce3-4e6a-9ea6-cca6a6245abe service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:47.381711 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 571/1135] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:49.578599 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fed60-26be-4f92-84b8-c8f8a56d3e69 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:49.579194 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fed60-26be-4f92-84b8-c8f8a56d3e69 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:49.579194 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fed60-26be-4f92-84b8-c8f8a56d3e69 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:49.580508 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 565/1136] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 00:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:49:49.585959 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe748e76-b0e5-467b-8d9f-636cc9c66bf9 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:49.586381 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe748e76-b0e5-467b-8d9f-636cc9c66bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:49.586477 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe748e76-b0e5-467b-8d9f-636cc9c66bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:49.651075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-fe748e76-b0e5-467b-8d9f-636cc9c66bf9 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:49.652185 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fe748e76-b0e5-467b-8d9f-636cc9c66bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:49.660532 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:49.749356 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 572/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 00:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:50.034111 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fed60-26be-4f92-84b8-c8f8a56d3e69 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:50.035678 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-200fed60-26be-4f92-84b8-c8f8a56d3e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:50.137092 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fed60-26be-4f92-84b8-c8f8a56d3e69 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:50.191887 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:50.210074 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9dd12a-30c2-4109-a720-71f78ae43945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:50.210662 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dd12a-30c2-4109-a720-71f78ae43945 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:50.210932 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dd12a-30c2-4109-a720-71f78ae43945 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:50.211196 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dd12a-30c2-4109-a720-71f78ae43945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:50.212821 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ca9dd12a-30c2-4109-a720-71f78ae43945 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:50.320965 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9dd12a-30c2-4109-a720-71f78ae43945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:50.322864 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9dd12a-30c2-4109-a720-71f78ae43945 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:50.340394 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 566/1138] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:52.541204 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2efce-962d-4a8c-80e0-cddaf2a565ef None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:52.541773 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2efce-962d-4a8c-80e0-cddaf2a565ef None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:52.541773 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2efce-962d-4a8c-80e0-cddaf2a565ef None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:52.543146 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 573/1139] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 00:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:49:52.548571 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d19f1-7ff6-4966-b966-1099f5652a5b None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:52.549001 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d19f1-7ff6-4966-b966-1099f5652a5b None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:52.549107 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d19f1-7ff6-4966-b966-1099f5652a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:52.613655 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-9e7d19f1-7ff6-4966-b966-1099f5652a5b None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:52.614846 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9e7d19f1-7ff6-4966-b966-1099f5652a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:52.652648 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:52.710729 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 567/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 00:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:52.994590 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2efce-962d-4a8c-80e0-cddaf2a565ef None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:52.996236 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2cd2efce-962d-4a8c-80e0-cddaf2a565ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:53.095561 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2efce-962d-4a8c-80e0-cddaf2a565ef None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:53.134223 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:53.169782 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94b6da-a591-45b6-a91f-426d0da02b2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:53.170382 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94b6da-a591-45b6-a91f-426d0da02b2e service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:53.170655 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94b6da-a591-45b6-a91f-426d0da02b2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:53.170923 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94b6da-a591-45b6-a91f-426d0da02b2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:53.172501 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3a94b6da-a591-45b6-a91f-426d0da02b2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:53.279781 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94b6da-a591-45b6-a91f-426d0da02b2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:53.281225 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94b6da-a591-45b6-a91f-426d0da02b2e service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:53.298933 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 574/1141] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:55.487994 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbec48d-e067-4f1e-84be-ba44b75cc030 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:55.488525 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbec48d-e067-4f1e-84be-ba44b75cc030 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:55.488525 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbec48d-e067-4f1e-84be-ba44b75cc030 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:55.489899 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 568/1142] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 00:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:49:55.495172 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86620cf7-0f80-42d2-8b87-873b378fdfe5 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:55.495609 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86620cf7-0f80-42d2-8b87-873b378fdfe5 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:55.495707 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86620cf7-0f80-42d2-8b87-873b378fdfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:55.561598 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-86620cf7-0f80-42d2-8b87-873b378fdfe5 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:55.562727 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-86620cf7-0f80-42d2-8b87-873b378fdfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:55.580811 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:55.659588 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 575/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 00:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:49:55.943921 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbec48d-e067-4f1e-84be-ba44b75cc030 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:55.945496 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-3dbec48d-e067-4f1e-84be-ba44b75cc030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:56.049496 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbec48d-e067-4f1e-84be-ba44b75cc030 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:56.115119 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:56.122710 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d789d2-93a3-4978-86ab-ecf61863c27a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:56.123297 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d789d2-93a3-4978-86ab-ecf61863c27a service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:56.123569 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d789d2-93a3-4978-86ab-ecf61863c27a service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:56.123837 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d789d2-93a3-4978-86ab-ecf61863c27a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:56.125444 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-d5d789d2-93a3-4978-86ab-ecf61863c27a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:56.232901 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d789d2-93a3-4978-86ab-ecf61863c27a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:56.234254 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d789d2-93a3-4978-86ab-ecf61863c27a service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:56.252495 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 569/1144] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:58.428588 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8ab32-0e06-4323-8f41-235d1bad4ded None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:58.429173 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8ab32-0e06-4323-8f41-235d1bad4ded None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:58.429173 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8ab32-0e06-4323-8f41-235d1bad4ded None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:58.430552 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 576/1145] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 00:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:49:58.436284 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f5deb-6a54-4b10-80a8-895ca19830a3 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:58.436714 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f5deb-6a54-4b10-80a8-895ca19830a3 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:58.436904 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f5deb-6a54-4b10-80a8-895ca19830a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:58.500640 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-4d4f5deb-6a54-4b10-80a8-895ca19830a3 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:58.501843 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-4d4f5deb-6a54-4b10-80a8-895ca19830a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:58.548923 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:58.596961 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 570/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 00:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:58.878419 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8ab32-0e06-4323-8f41-235d1bad4ded None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:58.879949 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2ed8ab32-0e06-4323-8f41-235d1bad4ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:58.982410 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8ab32-0e06-4323-8f41-235d1bad4ded None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:59.033817 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:59.059064 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32425cc-3a51-4d61-bc65-9c023d7c3bd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:59.059660 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32425cc-3a51-4d61-bc65-9c023d7c3bd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:59.059962 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32425cc-3a51-4d61-bc65-9c023d7c3bd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:59.060228 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32425cc-3a51-4d61-bc65-9c023d7c3bd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:59.061920 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e32425cc-3a51-4d61-bc65-9c023d7c3bd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:59.170689 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32425cc-3a51-4d61-bc65-9c023d7c3bd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:59.172076 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32425cc-3a51-4d61-bc65-9c023d7c3bd3 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:59.189997 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 577/1147] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:50:08.595434 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=22 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:09.187759 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=66 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:19.168829 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696eefd5-2a10-4671-9545-40ee7d8371c3 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:19.169422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696eefd5-2a10-4671-9545-40ee7d8371c3 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:19.169422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696eefd5-2a10-4671-9545-40ee7d8371c3 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:19.170716 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 571/1148] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:50:19.175972 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74f90a-a762-4b79-b883-f28551fe32dc None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:19.176388 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74f90a-a762-4b79-b883-f28551fe32dc None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:19.176510 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74f90a-a762-4b79-b883-f28551fe32dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:19.241283 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-6a74f90a-a762-4b79-b883-f28551fe32dc None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:50:19.242474 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6a74f90a-a762-4b79-b883-f28551fe32dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:19.338122 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 578/1149] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:50:19.633399 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3435d-0520-444e-8102-54af1b2e7abc None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:19.633683 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3435d-0520-444e-8102-54af1b2e7abc None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:19.633963 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3435d-0520-444e-8102-54af1b2e7abc None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:19.635299 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 572/1150] 10.222.0.40 () {54 vars in 962 bytes} [Sun Oct 30 00:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:50:19.640506 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26bfaa-4c12-46b3-829d-88df394d75be None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:19.640785 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26bfaa-4c12-46b3-829d-88df394d75be None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:19.641054 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26bfaa-4c12-46b3-829d-88df394d75be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:19.719026 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-db26bfaa-4c12-46b3-829d-88df394d75be None None] MFA Rules not processed for user `507ae56497684fc08f05c65a3c23e898`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:50:19.720218 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-db26bfaa-4c12-46b3-829d-88df394d75be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:19.740588 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:19.794755 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 579/1151] 10.222.0.40 () {58 vars in 1059 bytes} [Sun Oct 30 00:50:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:50:19.802523 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3435d-0520-444e-8102-54af1b2e7abc None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:19.804031 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-3ad3435d-0520-444e-8102-54af1b2e7abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:19.906333 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3435d-0520-444e-8102-54af1b2e7abc None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:19.978123 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f430a1-3d68-41a5-9d07-f82cab29c63a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ae56497684fc08f05c65a3c23e898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:19.978720 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f430a1-3d68-41a5-9d07-f82cab29c63a service glance] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:19.978996 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f430a1-3d68-41a5-9d07-f82cab29c63a service glance] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:19.979268 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f430a1-3d68-41a5-9d07-f82cab29c63a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:19.980853 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-92f430a1-3d68-41a5-9d07-f82cab29c63a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:20.034817 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:20.090263 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f430a1-3d68-41a5-9d07-f82cab29c63a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:20.091682 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f430a1-3d68-41a5-9d07-f82cab29c63a service glance] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:20.109631 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 573/1152] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:50:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:50:22.357733 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabfc7f-135a-4d5b-b0e9-c3c6daa66227 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:22.358305 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabfc7f-135a-4d5b-b0e9-c3c6daa66227 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:22.358305 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabfc7f-135a-4d5b-b0e9-c3c6daa66227 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:22.359605 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 580/1153] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:50:22.365062 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82caea8d-97c7-4844-a85f-54d8a9377ec1 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:22.365537 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82caea8d-97c7-4844-a85f-54d8a9377ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:22.365645 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82caea8d-97c7-4844-a85f-54d8a9377ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:22.431931 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-82caea8d-97c7-4844-a85f-54d8a9377ec1 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:50:22.433122 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-82caea8d-97c7-4844-a85f-54d8a9377ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:22.526726 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 574/1154] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:50:22.802204 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeabfc7f-135a-4d5b-b0e9-c3c6daa66227 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:22.803742 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-aeabfc7f-135a-4d5b-b0e9-c3c6daa66227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:22.930795 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeabfc7f-135a-4d5b-b0e9-c3c6daa66227 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:22.980501 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:23.024354 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef457c8-c555-4b59-9e1f-bbfbdfdb59b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:23.025534 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef457c8-c555-4b59-9e1f-bbfbdfdb59b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:23.025812 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef457c8-c555-4b59-9e1f-bbfbdfdb59b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:23.026079 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef457c8-c555-4b59-9e1f-bbfbdfdb59b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:23.026723 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef457c8-c555-4b59-9e1f-bbfbdfdb59b9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:23.027845 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: WARNING py.warnings [None req-4ef457c8-c555-4b59-9e1f-bbfbdfdb59b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:50:23.027845 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: warnings.warn(msg) Oct 30 00:50:23.027845 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: Oct 30 00:50:23.029263 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef457c8-c555-4b59-9e1f-bbfbdfdb59b9 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:23.048154 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 581/1155] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Oct 30 00:50:22 2022] GET /identity/v3/projects => generated 2553 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:50:25.211899 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c02a8-faf8-42f0-9324-e073bd56b234 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:25.212508 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c02a8-faf8-42f0-9324-e073bd56b234 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:25.212508 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c02a8-faf8-42f0-9324-e073bd56b234 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:25.214068 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 575/1156] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:50:25.219207 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf2311-049a-4fd1-83fd-77105d785d96 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:25.219608 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf2311-049a-4fd1-83fd-77105d785d96 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:25.219753 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf2311-049a-4fd1-83fd-77105d785d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:25.288871 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-9caf2311-049a-4fd1-83fd-77105d785d96 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:50:25.289757 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9caf2311-049a-4fd1-83fd-77105d785d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:25.387208 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 582/1157] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:50:25.687022 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c02a8-faf8-42f0-9324-e073bd56b234 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:25.688685 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ac1c02a8-faf8-42f0-9324-e073bd56b234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:25.699138 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:25.835035 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c02a8-faf8-42f0-9324-e073bd56b234 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:25.913635 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:25.946422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ae66d-7dd8-4ea8-9cbd-ad36e0876a2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:25.947045 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ae66d-7dd8-4ea8-9cbd-ad36e0876a2d service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:25.947322 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ae66d-7dd8-4ea8-9cbd-ad36e0876a2d service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:25.947592 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ae66d-7dd8-4ea8-9cbd-ad36e0876a2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:25.949210 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8a2ae66d-7dd8-4ea8-9cbd-ad36e0876a2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:26.038380 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ae66d-7dd8-4ea8-9cbd-ad36e0876a2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:26.040442 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ae66d-7dd8-4ea8-9cbd-ad36e0876a2d service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:26.058241 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 576/1158] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:50:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:50:28.388928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605669be-8883-47f6-b431-3907cef2fb71 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:28.389505 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605669be-8883-47f6-b431-3907cef2fb71 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:28.389505 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605669be-8883-47f6-b431-3907cef2fb71 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:28.390842 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 583/1159] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:50:28.396088 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56784093-525b-4296-bd69-f71e1a1a71da None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:28.396483 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56784093-525b-4296-bd69-f71e1a1a71da None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:28.396637 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56784093-525b-4296-bd69-f71e1a1a71da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:28.461684 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-56784093-525b-4296-bd69-f71e1a1a71da None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:50:28.463405 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-56784093-525b-4296-bd69-f71e1a1a71da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:28.507760 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:28.558291 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 577/1160] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:50:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:50:28.846691 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605669be-8883-47f6-b431-3907cef2fb71 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:28.848224 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-605669be-8883-47f6-b431-3907cef2fb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:28.871905 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:28.950125 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605669be-8883-47f6-b431-3907cef2fb71 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:29.022221 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea96139-196d-4bf6-9cd5-b6e2bfe4f391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:29.022842 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea96139-196d-4bf6-9cd5-b6e2bfe4f391 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:29.023106 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea96139-196d-4bf6-9cd5-b6e2bfe4f391 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:29.023374 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea96139-196d-4bf6-9cd5-b6e2bfe4f391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:29.024989 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4ea96139-196d-4bf6-9cd5-b6e2bfe4f391 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:29.098695 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:29.134769 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea96139-196d-4bf6-9cd5-b6e2bfe4f391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:29.136188 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea96139-196d-4bf6-9cd5-b6e2bfe4f391 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:29.153922 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 584/1161] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:50:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:50:31.346812 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c1984-9706-4f34-beca-570b992d20e3 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:31.347358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c1984-9706-4f34-beca-570b992d20e3 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:31.347358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c1984-9706-4f34-beca-570b992d20e3 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:31.348692 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 578/1162] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:50:31.354477 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c23afc-48ea-4143-9c45-6aaf64fa4d72 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:31.354862 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c23afc-48ea-4143-9c45-6aaf64fa4d72 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:31.355028 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c23afc-48ea-4143-9c45-6aaf64fa4d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:31.421786 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-e0c23afc-48ea-4143-9c45-6aaf64fa4d72 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:50:31.422984 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e0c23afc-48ea-4143-9c45-6aaf64fa4d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:31.517444 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 585/1163] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:50:31.806102 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c1984-9706-4f34-beca-570b992d20e3 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:31.807667 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-357c1984-9706-4f34-beca-570b992d20e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:31.909310 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c1984-9706-4f34-beca-570b992d20e3 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:31.978924 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:31.980432 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b8045-39cc-41c3-9f72-90f7a88e93dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:31.981328 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b8045-39cc-41c3-9f72-90f7a88e93dc service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:31.981833 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b8045-39cc-41c3-9f72-90f7a88e93dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:31.982166 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b8045-39cc-41c3-9f72-90f7a88e93dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:31.984125 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-e56b8045-39cc-41c3-9f72-90f7a88e93dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:32.102189 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b8045-39cc-41c3-9f72-90f7a88e93dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:32.103640 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b8045-39cc-41c3-9f72-90f7a88e93dc service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:32.121583 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 579/1164] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:50:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:50:34.444611 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d16b03-afdc-4635-a176-d10c25eab87c None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:34.445277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d16b03-afdc-4635-a176-d10c25eab87c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:34.445277 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d16b03-afdc-4635-a176-d10c25eab87c None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:34.446510 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 586/1165] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:50:34.451879 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff80cb-1cf7-4d66-8986-3c2a377f894b None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:34.452328 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff80cb-1cf7-4d66-8986-3c2a377f894b None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:34.452434 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff80cb-1cf7-4d66-8986-3c2a377f894b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:34.516477 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-2dff80cb-1cf7-4d66-8986-3c2a377f894b None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:50:34.517702 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-2dff80cb-1cf7-4d66-8986-3c2a377f894b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:34.569521 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:34.612912 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 580/1166] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:50:34.904396 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d16b03-afdc-4635-a176-d10c25eab87c None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:34.905988 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c2d16b03-afdc-4635-a176-d10c25eab87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:34.940884 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:35.008845 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d16b03-afdc-4635-a176-d10c25eab87c None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:35.080559 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf0278-d29e-49f7-96d1-a524fb2d9ef8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:35.081151 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf0278-d29e-49f7-96d1-a524fb2d9ef8 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:35.081454 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf0278-d29e-49f7-96d1-a524fb2d9ef8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:35.081718 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf0278-d29e-49f7-96d1-a524fb2d9ef8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:35.083292 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-51bf0278-d29e-49f7-96d1-a524fb2d9ef8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:35.162322 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:35.191919 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf0278-d29e-49f7-96d1-a524fb2d9ef8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:35.193387 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf0278-d29e-49f7-96d1-a524fb2d9ef8 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:35.210823 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 587/1167] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:50:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:50:37.579989 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27ae74-f12b-420e-9c5c-fed7b2e6db18 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:37.580540 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27ae74-f12b-420e-9c5c-fed7b2e6db18 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:37.580540 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27ae74-f12b-420e-9c5c-fed7b2e6db18 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:37.581886 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 581/1168] 10.222.0.40 () {54 vars in 927 bytes} [Sun Oct 30 00:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:50:37.587633 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d70063-c815-414e-a250-1eb572dac2db None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:37.588084 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d70063-c815-414e-a250-1eb572dac2db None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:37.588192 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d70063-c815-414e-a250-1eb572dac2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:37.653038 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-d1d70063-c815-414e-a250-1eb572dac2db None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:50:37.654502 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d1d70063-c815-414e-a250-1eb572dac2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:37.751145 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 588/1169] 10.222.0.40 () {58 vars in 1024 bytes} [Sun Oct 30 00:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:50:38.037377 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27ae74-f12b-420e-9c5c-fed7b2e6db18 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:38.038921 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9e27ae74-f12b-420e-9c5c-fed7b2e6db18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:38.142509 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27ae74-f12b-420e-9c5c-fed7b2e6db18 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:38.213587 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26ced2-2fbd-4dd3-a3b7-2a6db5ce25a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:38.214168 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26ced2-2fbd-4dd3-a3b7-2a6db5ce25a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:38.214436 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26ced2-2fbd-4dd3-a3b7-2a6db5ce25a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:38.214696 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26ced2-2fbd-4dd3-a3b7-2a6db5ce25a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:38.216256 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-6e26ced2-2fbd-4dd3-a3b7-2a6db5ce25a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:38.224586 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:38.325931 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26ced2-2fbd-4dd3-a3b7-2a6db5ce25a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:38.327662 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26ced2-2fbd-4dd3-a3b7-2a6db5ce25a0 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:38.348059 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 582/1170] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:50:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:50:47.749575 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=82 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:48.345151 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=50 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:06.373930 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667ef41-93e1-404c-aafa-b51b32554513 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:06.374524 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667ef41-93e1-404c-aafa-b51b32554513 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:06.374524 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667ef41-93e1-404c-aafa-b51b32554513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:06.449822 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-4667ef41-93e1-404c-aafa-b51b32554513 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:06.451009 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4667ef41-93e1-404c-aafa-b51b32554513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:06.544948 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 589/1171] 10.222.0.40 () {58 vars in 958 bytes} [Sun Oct 30 00:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:52:06.552799 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e0674-acf9-469b-93ed-e64797080374 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:06.553302 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e0674-acf9-469b-93ed-e64797080374 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:06.553434 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e0674-acf9-469b-93ed-e64797080374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:06.627559 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-3e3e0674-acf9-469b-93ed-e64797080374 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:06.628677 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-3e3e0674-acf9-469b-93ed-e64797080374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:06.724837 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 583/1172] 10.222.0.40 () {58 vars in 958 bytes} [Sun Oct 30 00:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:52:06.729498 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667ef41-93e1-404c-aafa-b51b32554513 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:06.730683 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4667ef41-93e1-404c-aafa-b51b32554513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:06.742312 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667ef41-93e1-404c-aafa-b51b32554513 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:06.801612 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:06.837287 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702982a-bd33-4562-b016-0e3b93abd583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:06.837804 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702982a-bd33-4562-b016-0e3b93abd583 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:06.838073 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702982a-bd33-4562-b016-0e3b93abd583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:06.838333 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702982a-bd33-4562-b016-0e3b93abd583 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:06.838954 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5702982a-bd33-4562-b016-0e3b93abd583 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:06.839250 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5702982a-bd33-4562-b016-0e3b93abd583 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:06.840274 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: WARNING py.warnings [None req-5702982a-bd33-4562-b016-0e3b93abd583 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:52:06.840274 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: warnings.warn(msg) Oct 30 00:52:06.840274 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: Oct 30 00:52:06.841137 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5702982a-bd33-4562-b016-0e3b93abd583 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:06.852003 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 590/1173] 10.222.0.40 () {58 vars in 1153 bytes} [Sun Oct 30 00:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:06.861512 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e0674-acf9-469b-93ed-e64797080374 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:06.871122 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e0674-acf9-469b-93ed-e64797080374 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:06.931572 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:06.964887 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec0ffa-a387-4db9-8642-78be2c877f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:06.965499 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec0ffa-a387-4db9-8642-78be2c877f91 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:06.965770 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec0ffa-a387-4db9-8642-78be2c877f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:06.966035 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec0ffa-a387-4db9-8642-78be2c877f91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:06.966642 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec0ffa-a387-4db9-8642-78be2c877f91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:06.967735 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: WARNING py.warnings [None req-09ec0ffa-a387-4db9-8642-78be2c877f91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:52:06.967735 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: warnings.warn(msg) Oct 30 00:52:06.967735 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: Oct 30 00:52:06.968900 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec0ffa-a387-4db9-8642-78be2c877f91 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:07.023852 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 584/1174] 10.222.0.40 () {60 vars in 1153 bytes} [Sun Oct 30 00:52:06 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:52:07.027991 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702982a-bd33-4562-b016-0e3b93abd583 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:07.029805 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-5702982a-bd33-4562-b016-0e3b93abd583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:07.062852 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702982a-bd33-4562-b016-0e3b93abd583 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:07.154051 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741cddab-9d3e-4fb9-a682-96bee6542e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:07.154658 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cddab-9d3e-4fb9-a682-96bee6542e5c admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:07.154916 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cddab-9d3e-4fb9-a682-96bee6542e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:07.155183 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cddab-9d3e-4fb9-a682-96bee6542e5c admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:07.155792 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741cddab-9d3e-4fb9-a682-96bee6542e5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:07.156789 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: WARNING py.warnings [None req-741cddab-9d3e-4fb9-a682-96bee6542e5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:52:07.156789 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: warnings.warn(msg) Oct 30 00:52:07.156789 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: Oct 30 00:52:07.158015 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741cddab-9d3e-4fb9-a682-96bee6542e5c admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:07.201167 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 591/1175] 10.222.0.40 () {60 vars in 1144 bytes} [Sun Oct 30 00:52:07 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:52:07.205129 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec0ffa-a387-4db9-8642-78be2c877f91 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:07.206704 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-09ec0ffa-a387-4db9-8642-78be2c877f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:07.267668 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec0ffa-a387-4db9-8642-78be2c877f91 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:07.352281 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:07.363306 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f128e3a-47fd-4f2a-b157-efd76a970802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:07.363898 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f128e3a-47fd-4f2a-b157-efd76a970802 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:07.364172 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f128e3a-47fd-4f2a-b157-efd76a970802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:07.364439 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f128e3a-47fd-4f2a-b157-efd76a970802 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:07.365066 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f128e3a-47fd-4f2a-b157-efd76a970802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:07.367262 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f128e3a-47fd-4f2a-b157-efd76a970802 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:07.379267 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 585/1176] 10.222.0.40 () {58 vars in 1122 bytes} [Sun Oct 30 00:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:52:07.383265 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741cddab-9d3e-4fb9-a682-96bee6542e5c admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:07.384765 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-741cddab-9d3e-4fb9-a682-96bee6542e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:07.395904 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741cddab-9d3e-4fb9-a682-96bee6542e5c admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:07.420905 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:07.490301 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54b4c9-60cb-413d-8831-f43308aaf7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:07.490822 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54b4c9-60cb-413d-8831-f43308aaf7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:07.491665 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54b4c9-60cb-413d-8831-f43308aaf7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:07.491951 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54b4c9-60cb-413d-8831-f43308aaf7d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:07.492576 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54b4c9-60cb-413d-8831-f43308aaf7d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:07.494166 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54b4c9-60cb-413d-8831-f43308aaf7d5 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:07.505964 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 592/1177] 10.222.0.40 () {58 vars in 1122 bytes} [Sun Oct 30 00:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:52:07.510722 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f128e3a-47fd-4f2a-b157-efd76a970802 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:07.512233 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-6f128e3a-47fd-4f2a-b157-efd76a970802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:07.545757 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f128e3a-47fd-4f2a-b157-efd76a970802 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:07.637590 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76644d49-bc69-422e-a840-1dd8000463d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:07.638208 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76644d49-bc69-422e-a840-1dd8000463d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:07.638476 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76644d49-bc69-422e-a840-1dd8000463d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:07.638739 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76644d49-bc69-422e-a840-1dd8000463d6 admin admin] PATH_INFO: `/v3/projects/92c6d86ab98b4cb998ba6e9871f2e9e9/users/e07b4e1adee14387838de3561ddf6563/roles/a2f2dde26304402eb433d8d8cfaca1e7` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:07.660519 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76644d49-bc69-422e-a840-1dd8000463d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92c6d86ab98b4cb998ba6e9871f2e9e9, user_id=e07b4e1adee14387838de3561ddf6563, role_id=a2f2dde26304402eb433d8d8cfaca1e7)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:07.663237 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76644d49-bc69-422e-a840-1dd8000463d6 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:07.688557 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 586/1178] 10.222.0.40 () {60 vars in 1483 bytes} [Sun Oct 30 00:52:07 2022] PUT /identity/v3/projects/92c6d86ab98b4cb998ba6e9871f2e9e9/users/e07b4e1adee14387838de3561ddf6563/roles/a2f2dde26304402eb433d8d8cfaca1e7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:52:07.700044 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98945074-4169-489e-8522-333f15c7cd3b None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:07.700377 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98945074-4169-489e-8522-333f15c7cd3b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:07.700601 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98945074-4169-489e-8522-333f15c7cd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:07.758558 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-98945074-4169-489e-8522-333f15c7cd3b None None] MFA Rules not processed for user `e07b4e1adee14387838de3561ddf6563`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:07.759749 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-98945074-4169-489e-8522-333f15c7cd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:07.835021 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 593/1179] 10.222.0.40 () {58 vars in 958 bytes} [Sun Oct 30 00:52:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:52:07.847980 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc2925-f3ac-4519-b326-2402e8cb5b02 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:07.848266 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc2925-f3ac-4519-b326-2402e8cb5b02 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:07.848543 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc2925-f3ac-4519-b326-2402e8cb5b02 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:07.849911 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 587/1180] 10.222.0.40 () {54 vars in 963 bytes} [Sun Oct 30 00:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:07.854569 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52ef4c-3e27-4499-a9c0-32cbd3ad6c5e None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:07.854852 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52ef4c-3e27-4499-a9c0-32cbd3ad6c5e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:07.855123 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52ef4c-3e27-4499-a9c0-32cbd3ad6c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:07.886871 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:07.932594 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-dc52ef4c-3e27-4499-a9c0-32cbd3ad6c5e None None] MFA Rules not processed for user `0dfd57a56ebe41ebb2b836d1ab03e334`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:07.933828 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-dc52ef4c-3e27-4499-a9c0-32cbd3ad6c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:08.007013 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 594/1181] 10.222.0.40 () {58 vars in 1060 bytes} [Sun Oct 30 00:52:07 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:52:08.016729 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc2925-f3ac-4519-b326-2402e8cb5b02 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:08.018214 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c8cc2925-f3ac-4519-b326-2402e8cb5b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:08.068968 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:08.124891 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc2925-f3ac-4519-b326-2402e8cb5b02 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:08.200927 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddfb262-5c08-4b49-9ca0-32420678c9e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dfd57a56ebe41ebb2b836d1ab03e334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:08.201588 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddfb262-5c08-4b49-9ca0-32420678c9e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:08.201863 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddfb262-5c08-4b49-9ca0-32420678c9e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:08.202129 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddfb262-5c08-4b49-9ca0-32420678c9e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:08.203816 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-dddfb262-5c08-4b49-9ca0-32420678c9e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:08.301958 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddfb262-5c08-4b49-9ca0-32420678c9e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:08.303291 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddfb262-5c08-4b49-9ca0-32420678c9e2 service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:08.307257 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:08.325813 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 588/1182] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:52:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:52:08.371917 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf0c5e-9238-4ff1-a8ca-87204d3f1c17 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:08.372202 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf0c5e-9238-4ff1-a8ca-87204d3f1c17 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:08.372475 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf0c5e-9238-4ff1-a8ca-87204d3f1c17 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:08.373751 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 595/1183] 10.222.0.40 () {52 vars in 830 bytes} [Sun Oct 30 00:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:08.377534 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddfb262-5c08-4b49-9ca0-32420678c9e2 service cinder] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:08.378925 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-dddfb262-5c08-4b49-9ca0-32420678c9e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:08.476546 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddfb262-5c08-4b49-9ca0-32420678c9e2 service cinder] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:08.584351 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f14e34-469a-4abb-880c-ace2bf36122d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:08.584878 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f14e34-469a-4abb-880c-ace2bf36122d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:08.585147 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f14e34-469a-4abb-880c-ace2bf36122d admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:08.585444 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f14e34-469a-4abb-880c-ace2bf36122d admin admin] PATH_INFO: `/v3/users/e07b4e1adee14387838de3561ddf6563` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:08.597766 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f14e34-469a-4abb-880c-ace2bf36122d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e07b4e1adee14387838de3561ddf6563)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:08.598780 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: WARNING py.warnings [None req-f4f14e34-469a-4abb-880c-ace2bf36122d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:52:08.598780 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: warnings.warn(msg) Oct 30 00:52:08.598780 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: Oct 30 00:52:08.599995 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f14e34-469a-4abb-880c-ace2bf36122d admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:08.609281 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:08.665207 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f4f14e34-469a-4abb-880c-ace2bf36122d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e07b4e1adee14387838de3561ddf6563'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:52:08.674622 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f4f14e34-469a-4abb-880c-ace2bf36122d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e07b4e1adee14387838de3561ddf6563'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:52:08.699025 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f4f14e34-469a-4abb-880c-ace2bf36122d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e07b4e1adee14387838de3561ddf6563'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:52:08.699490 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f4f14e34-469a-4abb-880c-ace2bf36122d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e07b4e1adee14387838de3561ddf6563'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:52:08.700000 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f4f14e34-469a-4abb-880c-ace2bf36122d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e07b4e1adee14387838de3561ddf6563'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:52:08.718939 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 589/1184] 10.222.0.40 () {58 vars in 1224 bytes} [Sun Oct 30 00:52:08 2022] DELETE /identity/v3/users/e07b4e1adee14387838de3561ddf6563 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:52:08.723385 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68b0b6-4a1c-4d62-ba09-7d7fd702eae8 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:08.723880 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68b0b6-4a1c-4d62-ba09-7d7fd702eae8 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:08.723994 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68b0b6-4a1c-4d62-ba09-7d7fd702eae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:08.781363 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-af68b0b6-4a1c-4d62-ba09-7d7fd702eae8 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:08.782599 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-af68b0b6-4a1c-4d62-ba09-7d7fd702eae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:08.858158 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:08.871507 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 596/1185] 10.222.0.40 () {58 vars in 958 bytes} [Sun Oct 30 00:52:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:52:08.881894 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f14e34-469a-4abb-880c-ace2bf36122d admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:08.883160 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-f4f14e34-469a-4abb-880c-ace2bf36122d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:08.981897 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f14e34-469a-4abb-880c-ace2bf36122d admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:09.041458 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:09.062102 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7852bb4-2a4a-4c60-b176-c715fc282aa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:09.062716 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7852bb4-2a4a-4c60-b176-c715fc282aa1 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:09.063019 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7852bb4-2a4a-4c60-b176-c715fc282aa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:09.063290 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7852bb4-2a4a-4c60-b176-c715fc282aa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:09.064926 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-b7852bb4-2a4a-4c60-b176-c715fc282aa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:09.188949 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7852bb4-2a4a-4c60-b176-c715fc282aa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:09.190446 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7852bb4-2a4a-4c60-b176-c715fc282aa1 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:09.210384 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 590/1186] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:52:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:52:09.559500 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68b0b6-4a1c-4d62-ba09-7d7fd702eae8 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:09.560747 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-af68b0b6-4a1c-4d62-ba09-7d7fd702eae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:09.572141 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68b0b6-4a1c-4d62-ba09-7d7fd702eae8 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:09.671228 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76425a27-bf3f-45fa-a314-8eb97c0b382c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:09.671228 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76425a27-bf3f-45fa-a314-8eb97c0b382c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:09.671477 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76425a27-bf3f-45fa-a314-8eb97c0b382c admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:09.671741 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76425a27-bf3f-45fa-a314-8eb97c0b382c admin admin] PATH_INFO: `/v3/projects/92c6d86ab98b4cb998ba6e9871f2e9e9` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:09.681583 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76425a27-bf3f-45fa-a314-8eb97c0b382c admin admin] RBAC: Authorizing `identity:delete_project(project_id=92c6d86ab98b4cb998ba6e9871f2e9e9)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:09.682596 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: WARNING py.warnings [None req-76425a27-bf3f-45fa-a314-8eb97c0b382c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:52:09.682596 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: warnings.warn(msg) Oct 30 00:52:09.682596 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: Oct 30 00:52:09.683783 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76425a27-bf3f-45fa-a314-8eb97c0b382c admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:09.741585 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-76425a27-bf3f-45fa-a314-8eb97c0b382c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92c6d86ab98b4cb998ba6e9871f2e9e9', 'request_id': 'req-76425a27-bf3f-45fa-a314-8eb97c0b382c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:52:09.754681 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-76425a27-bf3f-45fa-a314-8eb97c0b382c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92c6d86ab98b4cb998ba6e9871f2e9e9', 'request_id': 'req-76425a27-bf3f-45fa-a314-8eb97c0b382c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:52:09.761116 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-76425a27-bf3f-45fa-a314-8eb97c0b382c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92c6d86ab98b4cb998ba6e9871f2e9e9', 'request_id': 'req-76425a27-bf3f-45fa-a314-8eb97c0b382c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:52:09.787677 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-76425a27-bf3f-45fa-a314-8eb97c0b382c admin admin] The token cache is being invalidate because project 92c6d86ab98b4cb998ba6e9871f2e9e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:52:09.787983 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-76425a27-bf3f-45fa-a314-8eb97c0b382c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:52:09.788403 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-76425a27-bf3f-45fa-a314-8eb97c0b382c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:52:09.789790 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 597/1187] 10.222.0.40 () {58 vars in 1233 bytes} [Sun Oct 30 00:52:09 2022] DELETE /identity/v3/projects/92c6d86ab98b4cb998ba6e9871f2e9e9 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:52:19.207949 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=62 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:19.785677 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:23.709666 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de43a2-78ca-42c5-842e-9b7e9c897783 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:23.710203 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de43a2-78ca-42c5-842e-9b7e9c897783 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:23.710203 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de43a2-78ca-42c5-842e-9b7e9c897783 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:23.711664 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 591/1188] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 00:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:23.716715 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f3113-1777-4356-8392-fd9f80c816ea None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:23.717182 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f3113-1777-4356-8392-fd9f80c816ea None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:23.717309 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f3113-1777-4356-8392-fd9f80c816ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:23.797185 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-9c8f3113-1777-4356-8392-fd9f80c816ea None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:23.798412 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9c8f3113-1777-4356-8392-fd9f80c816ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:23.901167 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 598/1189] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 00:53:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:53:24.059313 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de43a2-78ca-42c5-842e-9b7e9c897783 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:24.061495 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-05de43a2-78ca-42c5-842e-9b7e9c897783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:24.180589 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de43a2-78ca-42c5-842e-9b7e9c897783 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:24.186128 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868c25f-dc94-476e-a4b9-343c26026fce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:24.186729 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868c25f-dc94-476e-a4b9-343c26026fce service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:24.187008 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868c25f-dc94-476e-a4b9-343c26026fce service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:24.187282 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868c25f-dc94-476e-a4b9-343c26026fce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:24.195372 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868c25f-dc94-476e-a4b9-343c26026fce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:24.197527 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868c25f-dc94-476e-a4b9-343c26026fce service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:24.206807 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 592/1190] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:53:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:53:25.280363 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54a3ee-6894-430e-8115-cec2bd8ed9f2 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:25.280938 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54a3ee-6894-430e-8115-cec2bd8ed9f2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:25.280938 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54a3ee-6894-430e-8115-cec2bd8ed9f2 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:25.282267 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 599/1191] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 00:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:25.287061 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42840285-0c2c-457a-96e8-963b126608e2 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:25.287444 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42840285-0c2c-457a-96e8-963b126608e2 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:25.287619 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42840285-0c2c-457a-96e8-963b126608e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:25.307988 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-42840285-0c2c-457a-96e8-963b126608e2 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:25.309226 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-42840285-0c2c-457a-96e8-963b126608e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:25.317039 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 593/1192] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 00:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:53:25.468232 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54a3ee-6894-430e-8115-cec2bd8ed9f2 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:25.482402 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54a3ee-6894-430e-8115-cec2bd8ed9f2 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:25.487685 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f556f6-b05c-4804-85ad-f755965afaaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:25.488260 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f556f6-b05c-4804-85ad-f755965afaaa service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:25.488530 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f556f6-b05c-4804-85ad-f755965afaaa service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:25.488795 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f556f6-b05c-4804-85ad-f755965afaaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:25.496896 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f556f6-b05c-4804-85ad-f755965afaaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:25.498473 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f556f6-b05c-4804-85ad-f755965afaaa service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:25.507801 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 600/1193] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:53:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:53:28.239889 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a4056-cc90-4caa-8a1d-ec9dd4a9200d None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:28.240414 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a4056-cc90-4caa-8a1d-ec9dd4a9200d None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:28.240414 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a4056-cc90-4caa-8a1d-ec9dd4a9200d None None] PATH_INFO: `/v3` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:28.241765 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 594/1194] 10.222.0.52 () {54 vars in 925 bytes} [Sun Oct 30 00:53:28 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:28.248463 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b3a04-60b7-4905-ac31-32b2c3012fc4 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:28.248913 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b3a04-60b7-4905-ac31-32b2c3012fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:28.249020 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b3a04-60b7-4905-ac31-32b2c3012fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:28.308953 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-354b3a04-60b7-4905-ac31-32b2c3012fc4 None None] MFA Rules not processed for user `d7f009bdf1d24ee4b879db926b8d44cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:28.310288 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-354b3a04-60b7-4905-ac31-32b2c3012fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:28.327813 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:28.381160 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 601/1195] 10.222.0.52 () {58 vars in 1015 bytes} [Sun Oct 30 00:53:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:53:31.870401 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89eb27c-eec3-4a7f-8ace-6ce8a409a756 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:31.870807 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89eb27c-eec3-4a7f-8ace-6ce8a409a756 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:31.870947 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89eb27c-eec3-4a7f-8ace-6ce8a409a756 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:31.872309 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 595/1196] 10.222.0.40 () {54 vars in 961 bytes} [Sun Oct 30 00:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:31.877283 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688c330-c0b4-4407-b07d-2acf896b1c4c None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:31.877671 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688c330-c0b4-4407-b07d-2acf896b1c4c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:31.877832 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688c330-c0b4-4407-b07d-2acf896b1c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:31.896879 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-e688c330-c0b4-4407-b07d-2acf896b1c4c None None] MFA Rules not processed for user `d7f009bdf1d24ee4b879db926b8d44cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:31.898108 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e688c330-c0b4-4407-b07d-2acf896b1c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:31.906801 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 602/1197] 10.222.0.40 () {58 vars in 1058 bytes} [Sun Oct 30 00:53:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:53:31.914300 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89eb27c-eec3-4a7f-8ace-6ce8a409a756 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:31.928149 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89eb27c-eec3-4a7f-8ace-6ce8a409a756 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:31.933848 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb2f0e-2259-472f-89a5-c3d934d1b687 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7f009bdf1d24ee4b879db926b8d44cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:31.934429 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb2f0e-2259-472f-89a5-c3d934d1b687 service placement] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:31.934708 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb2f0e-2259-472f-89a5-c3d934d1b687 service placement] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:31.934977 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb2f0e-2259-472f-89a5-c3d934d1b687 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:31.943097 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb2f0e-2259-472f-89a5-c3d934d1b687 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:31.944651 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb2f0e-2259-472f-89a5-c3d934d1b687 service placement] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:31.954167 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 596/1198] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:53:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:53:36.975225 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecd8e0-932f-46f6-a03c-1b4b055c2dc6 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:36.975857 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecd8e0-932f-46f6-a03c-1b4b055c2dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:36.975857 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecd8e0-932f-46f6-a03c-1b4b055c2dc6 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:36.976987 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 603/1199] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 00:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:36.981731 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cc2c6-7dca-43eb-acd9-ef048f758c60 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:36.982144 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cc2c6-7dca-43eb-acd9-ef048f758c60 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:36.982271 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cc2c6-7dca-43eb-acd9-ef048f758c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:37.001755 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-6b9cc2c6-7dca-43eb-acd9-ef048f758c60 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:37.002923 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-6b9cc2c6-7dca-43eb-acd9-ef048f758c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:37.011145 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 597/1200] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 00:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:53:37.164611 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecd8e0-932f-46f6-a03c-1b4b055c2dc6 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:37.178834 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecd8e0-932f-46f6-a03c-1b4b055c2dc6 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:37.184251 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f25e0b-60a6-4ece-889b-9f30c38a26fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:37.184829 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f25e0b-60a6-4ece-889b-9f30c38a26fe service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:37.185105 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f25e0b-60a6-4ece-889b-9f30c38a26fe service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:37.185405 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f25e0b-60a6-4ece-889b-9f30c38a26fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:37.193451 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f25e0b-60a6-4ece-889b-9f30c38a26fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:37.195035 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f25e0b-60a6-4ece-889b-9f30c38a26fe service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:37.205054 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 604/1201] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:53:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:53:38.258077 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dc9f7-26e8-4bdb-a33c-410570f40481 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:38.258652 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dc9f7-26e8-4bdb-a33c-410570f40481 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:38.258652 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dc9f7-26e8-4bdb-a33c-410570f40481 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:38.259974 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 598/1202] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 00:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:38.264797 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ee4d8-4906-4fa4-a75f-28b6e219702d None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:38.265256 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ee4d8-4906-4fa4-a75f-28b6e219702d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:38.265462 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ee4d8-4906-4fa4-a75f-28b6e219702d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:38.285551 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-bc4ee4d8-4906-4fa4-a75f-28b6e219702d None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:38.286802 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-bc4ee4d8-4906-4fa4-a75f-28b6e219702d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:38.296540 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 605/1203] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 00:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:53:38.449431 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30dc9f7-26e8-4bdb-a33c-410570f40481 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:38.464020 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30dc9f7-26e8-4bdb-a33c-410570f40481 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:38.469470 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5994289-f7f7-460d-a3bd-a175f731c082 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:38.470046 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5994289-f7f7-460d-a3bd-a175f731c082 service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:38.470322 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5994289-f7f7-460d-a3bd-a175f731c082 service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:38.470591 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5994289-f7f7-460d-a3bd-a175f731c082 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:38.479205 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5994289-f7f7-460d-a3bd-a175f731c082 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:38.480754 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5994289-f7f7-460d-a3bd-a175f731c082 service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:38.489924 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 599/1204] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:53:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:53:42.393619 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc326b5a-7a76-47f6-9152-1c4e77012dd0 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:42.394077 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc326b5a-7a76-47f6-9152-1c4e77012dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:42.394193 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc326b5a-7a76-47f6-9152-1c4e77012dd0 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:42.395505 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 606/1205] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 00:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:42.401308 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c414c-ac15-4844-ada8-c14756e2f48f None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:42.401818 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c414c-ac15-4844-ada8-c14756e2f48f None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:42.401929 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c414c-ac15-4844-ada8-c14756e2f48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:42.421391 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-e93c414c-ac15-4844-ada8-c14756e2f48f None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:42.422584 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-e93c414c-ac15-4844-ada8-c14756e2f48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:42.430366 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 600/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 00:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:53:42.718991 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc326b5a-7a76-47f6-9152-1c4e77012dd0 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:42.720675 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-bc326b5a-7a76-47f6-9152-1c4e77012dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:42.796611 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc326b5a-7a76-47f6-9152-1c4e77012dd0 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:42.800085 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481bbd49-ce36-4f39-9c31-d84c9d021987 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:42.800668 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bbd49-ce36-4f39-9c31-d84c9d021987 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:42.800941 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bbd49-ce36-4f39-9c31-d84c9d021987 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:42.801232 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bbd49-ce36-4f39-9c31-d84c9d021987 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:42.810340 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481bbd49-ce36-4f39-9c31-d84c9d021987 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:42.811740 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481bbd49-ce36-4f39-9c31-d84c9d021987 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:42.820824 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 607/1207] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:53:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:53:44.942714 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cea89-5e55-4f8b-bde0-5563436fbdfa None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:44.943241 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cea89-5e55-4f8b-bde0-5563436fbdfa None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:44.943241 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cea89-5e55-4f8b-bde0-5563436fbdfa None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:44.944484 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 601/1208] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 00:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:44.949794 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e1088-003e-42f3-b215-5bf4ecfd7d1b None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:44.950236 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e1088-003e-42f3-b215-5bf4ecfd7d1b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:44.950349 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e1088-003e-42f3-b215-5bf4ecfd7d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:44.971130 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-628e1088-003e-42f3-b215-5bf4ecfd7d1b None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:44.972319 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-628e1088-003e-42f3-b215-5bf4ecfd7d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:44.980568 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 608/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 00:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:53:45.264499 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cea89-5e55-4f8b-bde0-5563436fbdfa None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:45.275595 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cea89-5e55-4f8b-bde0-5563436fbdfa None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:45.279254 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9516fab-ce6a-4e14-8a25-d261d607ad3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:45.279830 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9516fab-ce6a-4e14-8a25-d261d607ad3a service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:45.280121 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9516fab-ce6a-4e14-8a25-d261d607ad3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:45.280370 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9516fab-ce6a-4e14-8a25-d261d607ad3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:45.289005 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9516fab-ce6a-4e14-8a25-d261d607ad3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:45.291017 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9516fab-ce6a-4e14-8a25-d261d607ad3a service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:45.300042 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 602/1210] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:53:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:53:49.033266 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f448b3-ce99-4aaa-bdfb-77db46053ebb None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:49.033816 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f448b3-ce99-4aaa-bdfb-77db46053ebb None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:49.033816 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f448b3-ce99-4aaa-bdfb-77db46053ebb None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:49.035183 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 609/1211] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 00:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:49.040284 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d913e-879c-47e6-8438-5a7a066efdf3 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:49.040796 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d913e-879c-47e6-8438-5a7a066efdf3 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:49.041432 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d913e-879c-47e6-8438-5a7a066efdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:49.061204 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-d15d913e-879c-47e6-8438-5a7a066efdf3 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:49.062393 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-d15d913e-879c-47e6-8438-5a7a066efdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:49.070035 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 603/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 00:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:53:49.370032 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f448b3-ce99-4aaa-bdfb-77db46053ebb None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:49.371724 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-58f448b3-ce99-4aaa-bdfb-77db46053ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:49.436476 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:49.450114 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f448b3-ce99-4aaa-bdfb-77db46053ebb None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:49.453636 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284db9f-85e9-4d90-ab36-ee55b0d05785 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dfd57a56ebe41ebb2b836d1ab03e334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:49.454226 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284db9f-85e9-4d90-ab36-ee55b0d05785 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:49.454500 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284db9f-85e9-4d90-ab36-ee55b0d05785 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:49.454764 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284db9f-85e9-4d90-ab36-ee55b0d05785 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:49.463886 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4284db9f-85e9-4d90-ab36-ee55b0d05785 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:49.465322 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4284db9f-85e9-4d90-ab36-ee55b0d05785 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:49.474519 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 610/1213] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:53:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:53:51.605212 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42722d47-f893-4626-b0fc-fc0423a26e72 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:51.605766 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42722d47-f893-4626-b0fc-fc0423a26e72 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:51.605766 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42722d47-f893-4626-b0fc-fc0423a26e72 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:51.607076 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 604/1214] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 00:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:51.612332 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac505a-be67-409c-83ea-d741ebf7f6d3 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:51.612758 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac505a-be67-409c-83ea-d741ebf7f6d3 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:51.612868 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac505a-be67-409c-83ea-d741ebf7f6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:51.632110 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-20ac505a-be67-409c-83ea-d741ebf7f6d3 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:51.633332 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-20ac505a-be67-409c-83ea-d741ebf7f6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:51.641587 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 611/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 00:53:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:53:51.936860 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42722d47-f893-4626-b0fc-fc0423a26e72 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:51.938589 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-42722d47-f893-4626-b0fc-fc0423a26e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:51.946082 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=84 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:51.953097 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42722d47-f893-4626-b0fc-fc0423a26e72 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:51.956615 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc03382-6fef-4087-85b1-9956a8928955 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dfd57a56ebe41ebb2b836d1ab03e334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:51.957215 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc03382-6fef-4087-85b1-9956a8928955 service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:51.957501 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc03382-6fef-4087-85b1-9956a8928955 service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:51.957773 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc03382-6fef-4087-85b1-9956a8928955 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:51.966654 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc03382-6fef-4087-85b1-9956a8928955 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:51.968064 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc03382-6fef-4087-85b1-9956a8928955 service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:51.977364 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 605/1216] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:53:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:54:01.627282 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=11 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:01.973210 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=5 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:07.495636 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568067a-8972-4874-964d-c8dfa95c6017 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:07.496287 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568067a-8972-4874-964d-c8dfa95c6017 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:07.496287 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568067a-8972-4874-964d-c8dfa95c6017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:07.501443 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17ea3b-96dc-45c1-ae1e-2e7a933c5d78 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:07.501867 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17ea3b-96dc-45c1-ae1e-2e7a933c5d78 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:07.501978 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17ea3b-96dc-45c1-ae1e-2e7a933c5d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:07.515939 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-1568067a-8972-4874-964d-c8dfa95c6017 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:07.517128 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-1568067a-8972-4874-964d-c8dfa95c6017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:07.522195 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-eb17ea3b-96dc-45c1-ae1e-2e7a933c5d78 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:07.523003 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-eb17ea3b-96dc-45c1-ae1e-2e7a933c5d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:07.527829 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 612/1217] 10.222.0.40 () {58 vars in 958 bytes} [Sun Oct 30 00:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:55:07.532578 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 606/1218] 10.222.0.40 () {58 vars in 958 bytes} [Sun Oct 30 00:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:55:07.537540 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7d7d0-2698-4d14-9f79-b754b1a8f01f None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:07.537825 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7d7d0-2698-4d14-9f79-b754b1a8f01f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:07.538098 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7d7d0-2698-4d14-9f79-b754b1a8f01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:07.542045 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f45e9-90b4-4c69-b1f5-9563049bc938 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:07.542335 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f45e9-90b4-4c69-b1f5-9563049bc938 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:07.542623 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f45e9-90b4-4c69-b1f5-9563049bc938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:07.557755 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-2fe7d7d0-2698-4d14-9f79-b754b1a8f01f None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:07.558947 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2fe7d7d0-2698-4d14-9f79-b754b1a8f01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:07.561389 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-255f45e9-90b4-4c69-b1f5-9563049bc938 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:07.562546 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-255f45e9-90b4-4c69-b1f5-9563049bc938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:07.566683 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 613/1219] 10.222.0.40 () {58 vars in 958 bytes} [Sun Oct 30 00:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:55:07.570385 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 607/1220] 10.222.0.40 () {58 vars in 958 bytes} [Sun Oct 30 00:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:55:07.571308 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7d7d0-2698-4d14-9f79-b754b1a8f01f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:07.574699 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f45e9-90b4-4c69-b1f5-9563049bc938 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:07.580893 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7d7d0-2698-4d14-9f79-b754b1a8f01f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:07.584068 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f45e9-90b4-4c69-b1f5-9563049bc938 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:07.585477 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f759886-70e3-478a-bba7-2f542939633c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:07.586050 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f759886-70e3-478a-bba7-2f542939633c admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:07.586327 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f759886-70e3-478a-bba7-2f542939633c admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:07.586594 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f759886-70e3-478a-bba7-2f542939633c admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:07.587222 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f759886-70e3-478a-bba7-2f542939633c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:55:07.587532 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f759886-70e3-478a-bba7-2f542939633c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:07.589031 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8a388-4713-40c2-9675-7d26f2d1c0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:07.589169 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f759886-70e3-478a-bba7-2f542939633c admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:07.589646 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8a388-4713-40c2-9675-7d26f2d1c0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:07.589923 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8a388-4713-40c2-9675-7d26f2d1c0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:07.590189 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8a388-4713-40c2-9675-7d26f2d1c0c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:07.590818 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8a388-4713-40c2-9675-7d26f2d1c0c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:55:07.591115 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8a388-4713-40c2-9675-7d26f2d1c0c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:07.592680 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: WARNING py.warnings [None req-87a8a388-4713-40c2-9675-7d26f2d1c0c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:55:07.592680 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: warnings.warn(msg) Oct 30 00:55:07.592680 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: Oct 30 00:55:07.593603 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8a388-4713-40c2-9675-7d26f2d1c0c4 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:07.601507 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 614/1221] 10.222.0.40 () {58 vars in 1153 bytes} [Sun Oct 30 00:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:55:07.612599 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 608/1222] 10.222.0.40 () {58 vars in 1153 bytes} [Sun Oct 30 00:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:55:07.613467 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8a388-4713-40c2-9675-7d26f2d1c0c4 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:07.613595 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f759886-70e3-478a-bba7-2f542939633c admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:07.623347 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f759886-70e3-478a-bba7-2f542939633c admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:07.623478 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8a388-4713-40c2-9675-7d26f2d1c0c4 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:07.628017 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1368a04-dbeb-4a81-80bc-54227dc86c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:07.628173 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d5af9-e761-4e0e-a01d-f8c83798d5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:07.628598 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1368a04-dbeb-4a81-80bc-54227dc86c14 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:07.628728 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d5af9-e761-4e0e-a01d-f8c83798d5dd admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:07.628869 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d5af9-e761-4e0e-a01d-f8c83798d5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:07.628982 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1368a04-dbeb-4a81-80bc-54227dc86c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:07.629140 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d5af9-e761-4e0e-a01d-f8c83798d5dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:07.629277 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1368a04-dbeb-4a81-80bc-54227dc86c14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:07.629797 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1368a04-dbeb-4a81-80bc-54227dc86c14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:07.629904 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d5af9-e761-4e0e-a01d-f8c83798d5dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:07.630791 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: WARNING py.warnings [None req-4d6d5af9-e761-4e0e-a01d-f8c83798d5dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:55:07.630791 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: warnings.warn(msg) Oct 30 00:55:07.630791 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: Oct 30 00:55:07.631679 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1368a04-dbeb-4a81-80bc-54227dc86c14 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:07.631973 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d5af9-e761-4e0e-a01d-f8c83798d5dd admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:07.669948 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 615/1223] 10.222.0.40 () {60 vars in 1153 bytes} [Sun Oct 30 00:55:07 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:55:07.670887 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 609/1224] 10.222.0.40 () {60 vars in 1153 bytes} [Sun Oct 30 00:55:07 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:55:07.673857 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d5af9-e761-4e0e-a01d-f8c83798d5dd admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:07.677134 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1368a04-dbeb-4a81-80bc-54227dc86c14 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:07.741744 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1368a04-dbeb-4a81-80bc-54227dc86c14 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:07.742005 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d5af9-e761-4e0e-a01d-f8c83798d5dd admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:07.746388 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1afad-7ba1-4ed8-8875-6259df07d9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:07.746637 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f448801-0754-4fa9-9183-4d5898b2d90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:07.746919 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1afad-7ba1-4ed8-8875-6259df07d9d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:07.747221 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1afad-7ba1-4ed8-8875-6259df07d9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:07.747325 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f448801-0754-4fa9-9183-4d5898b2d90d admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:07.747491 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1afad-7ba1-4ed8-8875-6259df07d9d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:07.747592 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f448801-0754-4fa9-9183-4d5898b2d90d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:07.748287 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f448801-0754-4fa9-9183-4d5898b2d90d admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:07.748609 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef1afad-7ba1-4ed8-8875-6259df07d9d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:07.748917 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f448801-0754-4fa9-9183-4d5898b2d90d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:07.749652 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: WARNING py.warnings [None req-cef1afad-7ba1-4ed8-8875-6259df07d9d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:55:07.749652 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: warnings.warn(msg) Oct 30 00:55:07.749652 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: Oct 30 00:55:07.750858 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f448801-0754-4fa9-9183-4d5898b2d90d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:07.751075 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef1afad-7ba1-4ed8-8875-6259df07d9d3 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:07.772638 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 616/1225] 10.222.0.40 () {60 vars in 1144 bytes} [Sun Oct 30 00:55:07 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:55:07.773957 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 610/1226] 10.222.0.40 () {60 vars in 1144 bytes} [Sun Oct 30 00:55:07 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:55:07.776699 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f448801-0754-4fa9-9183-4d5898b2d90d admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:07.778041 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1afad-7ba1-4ed8-8875-6259df07d9d3 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:07.786635 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f448801-0754-4fa9-9183-4d5898b2d90d admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:07.788000 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1afad-7ba1-4ed8-8875-6259df07d9d3 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:07.791229 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e1ce6-bfa6-461a-a07e-ebdccf8f24cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:07.791802 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e1ce6-bfa6-461a-a07e-ebdccf8f24cd admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:07.792082 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e1ce6-bfa6-461a-a07e-ebdccf8f24cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:07.792353 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e1ce6-bfa6-461a-a07e-ebdccf8f24cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:07.792679 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d21bf-8bb7-4f40-bb4e-d7d67a6a3ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:07.792991 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e1ce6-bfa6-461a-a07e-ebdccf8f24cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:07.793282 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d21bf-8bb7-4f40-bb4e-d7d67a6a3ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:07.793589 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d21bf-8bb7-4f40-bb4e-d7d67a6a3ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:07.793858 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d21bf-8bb7-4f40-bb4e-d7d67a6a3ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:07.794486 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d21bf-8bb7-4f40-bb4e-d7d67a6a3ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:07.794675 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e1ce6-bfa6-461a-a07e-ebdccf8f24cd admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:07.796117 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d21bf-8bb7-4f40-bb4e-d7d67a6a3ae6 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:07.805139 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 617/1227] 10.222.0.40 () {58 vars in 1122 bytes} [Sun Oct 30 00:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:55:07.806443 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 611/1228] 10.222.0.40 () {58 vars in 1122 bytes} [Sun Oct 30 00:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:55:07.811980 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e1ce6-bfa6-461a-a07e-ebdccf8f24cd admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:07.812150 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d21bf-8bb7-4f40-bb4e-d7d67a6a3ae6 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:07.821657 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e1ce6-bfa6-461a-a07e-ebdccf8f24cd admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:07.821820 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d21bf-8bb7-4f40-bb4e-d7d67a6a3ae6 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:07.826800 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23907620-8a80-47ea-ba1c-a973ac769ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:07.826956 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87664f-5101-434b-ba5c-dedc5152eada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:07.827362 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23907620-8a80-47ea-ba1c-a973ac769ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:07.827466 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87664f-5101-434b-ba5c-dedc5152eada admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:07.827631 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23907620-8a80-47ea-ba1c-a973ac769ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:07.827740 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87664f-5101-434b-ba5c-dedc5152eada admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:07.827888 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23907620-8a80-47ea-ba1c-a973ac769ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:07.827999 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87664f-5101-434b-ba5c-dedc5152eada admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:07.828542 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87664f-5101-434b-ba5c-dedc5152eada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:07.828650 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23907620-8a80-47ea-ba1c-a973ac769ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:07.830143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87664f-5101-434b-ba5c-dedc5152eada admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:07.830259 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23907620-8a80-47ea-ba1c-a973ac769ca4 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:07.840527 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 612/1229] 10.222.0.40 () {58 vars in 1122 bytes} [Sun Oct 30 00:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:55:07.843971 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 618/1230] 10.222.0.40 () {58 vars in 1122 bytes} [Sun Oct 30 00:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:55:07.845166 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87664f-5101-434b-ba5c-dedc5152eada admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:07.845338 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23907620-8a80-47ea-ba1c-a973ac769ca4 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:07.854768 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23907620-8a80-47ea-ba1c-a973ac769ca4 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:07.854919 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87664f-5101-434b-ba5c-dedc5152eada admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:07.859524 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b48d6-5966-404f-be7c-7156ba0f7eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:07.859672 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e5be2-e56f-40a5-bda5-5b32254d68f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:07.860148 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b48d6-5966-404f-be7c-7156ba0f7eb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:07.860255 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e5be2-e56f-40a5-bda5-5b32254d68f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:07.860423 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b48d6-5966-404f-be7c-7156ba0f7eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:07.860519 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e5be2-e56f-40a5-bda5-5b32254d68f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:07.860691 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b48d6-5966-404f-be7c-7156ba0f7eb2 admin admin] PATH_INFO: `/v3/projects/74f4e7742d0d472fb38e1b3bc92cf179/users/b8a65aed5ee544979ee1b460a71c99f8/roles/a2f2dde26304402eb433d8d8cfaca1e7` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:07.860805 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e5be2-e56f-40a5-bda5-5b32254d68f9 admin admin] PATH_INFO: `/v3/projects/3930cc14af6149c3aa4714f5fc902a76/users/86918f2d1f5342eeb2b5d3ab5048296c/roles/a2f2dde26304402eb433d8d8cfaca1e7` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:07.875510 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b48d6-5966-404f-be7c-7156ba0f7eb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74f4e7742d0d472fb38e1b3bc92cf179, user_id=b8a65aed5ee544979ee1b460a71c99f8, role_id=a2f2dde26304402eb433d8d8cfaca1e7)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:07.876484 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e5be2-e56f-40a5-bda5-5b32254d68f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3930cc14af6149c3aa4714f5fc902a76, user_id=86918f2d1f5342eeb2b5d3ab5048296c, role_id=a2f2dde26304402eb433d8d8cfaca1e7)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:07.878151 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b48d6-5966-404f-be7c-7156ba0f7eb2 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:07.879190 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e5be2-e56f-40a5-bda5-5b32254d68f9 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:07.891807 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 613/1231] 10.222.0.40 () {60 vars in 1483 bytes} [Sun Oct 30 00:55:07 2022] PUT /identity/v3/projects/74f4e7742d0d472fb38e1b3bc92cf179/users/b8a65aed5ee544979ee1b460a71c99f8/roles/a2f2dde26304402eb433d8d8cfaca1e7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:55:07.892455 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 619/1232] 10.222.0.40 () {60 vars in 1483 bytes} [Sun Oct 30 00:55:07 2022] PUT /identity/v3/projects/3930cc14af6149c3aa4714f5fc902a76/users/86918f2d1f5342eeb2b5d3ab5048296c/roles/a2f2dde26304402eb433d8d8cfaca1e7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:55:07.897091 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4532b-c1b6-4011-a199-597d21ae6dae None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:07.897504 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0dd435-44da-4ae9-9034-23d16cbcf795 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:07.897655 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4532b-c1b6-4011-a199-597d21ae6dae None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:07.897804 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4532b-c1b6-4011-a199-597d21ae6dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:07.897976 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0dd435-44da-4ae9-9034-23d16cbcf795 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:07.898090 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0dd435-44da-4ae9-9034-23d16cbcf795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:07.916501 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-7ae4532b-c1b6-4011-a199-597d21ae6dae None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:07.916938 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-0e0dd435-44da-4ae9-9034-23d16cbcf795 None None] MFA Rules not processed for user `3d17e3752b7a4a7facf7de1b529ec751`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:07.917732 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-7ae4532b-c1b6-4011-a199-597d21ae6dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:07.918186 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0e0dd435-44da-4ae9-9034-23d16cbcf795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:07.959560 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:07.960607 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:07.978526 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 620/1233] 10.222.0.40 () {58 vars in 958 bytes} [Sun Oct 30 00:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:55:07.983479 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 614/1234] 10.222.0.40 () {58 vars in 958 bytes} [Sun Oct 30 00:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:55:07.989418 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0dd435-44da-4ae9-9034-23d16cbcf795 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:07.990457 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4532b-c1b6-4011-a199-597d21ae6dae None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:07.991795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-7ae4532b-c1b6-4011-a199-597d21ae6dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:08.049077 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0dd435-44da-4ae9-9034-23d16cbcf795 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:08.049989 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4532b-c1b6-4011-a199-597d21ae6dae None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:08.052737 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7d80c-9809-4b2e-b6e2-a6effa0d458b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:08.053362 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7d80c-9809-4b2e-b6e2-a6effa0d458b service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:08.053632 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdf584-6a56-4c2b-a29e-9fa81ca378d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:08.053750 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7d80c-9809-4b2e-b6e2-a6effa0d458b service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:08.053892 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7d80c-9809-4b2e-b6e2-a6effa0d458b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:08.054227 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdf584-6a56-4c2b-a29e-9fa81ca378d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:08.054503 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdf584-6a56-4c2b-a29e-9fa81ca378d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:08.054771 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdf584-6a56-4c2b-a29e-9fa81ca378d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:08.063330 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7d80c-9809-4b2e-b6e2-a6effa0d458b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:08.064414 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cdf584-6a56-4c2b-a29e-9fa81ca378d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:08.064734 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7d80c-9809-4b2e-b6e2-a6effa0d458b service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:08.065909 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cdf584-6a56-4c2b-a29e-9fa81ca378d3 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:08.073963 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 621/1235] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:55:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:55:08.075567 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 615/1236] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:55:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:55:13.082862 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcfb9b-340d-435d-b48e-e706bd7364c5 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:13.083384 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcfb9b-340d-435d-b48e-e706bd7364c5 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:13.083592 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcfb9b-340d-435d-b48e-e706bd7364c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:13.152491 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a0dcfb9b-340d-435d-b48e-e706bd7364c5 None None] MFA Rules not processed for user `86918f2d1f5342eeb2b5d3ab5048296c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:13.153770 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a0dcfb9b-340d-435d-b48e-e706bd7364c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:13.270240 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 622/1237] 10.222.0.40 () {58 vars in 958 bytes} [Sun Oct 30 00:55:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:55:13.271499 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdf584-6a56-4c2b-a29e-9fa81ca378d3 service neutron] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:13.284236 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdf584-6a56-4c2b-a29e-9fa81ca378d3 service neutron] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:13.296443 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c4f21-1553-4578-82c5-78990df6b8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:13.297068 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c4f21-1553-4578-82c5-78990df6b8e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:13.298009 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c4f21-1553-4578-82c5-78990df6b8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:13.298009 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c4f21-1553-4578-82c5-78990df6b8e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:13.298326 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c4f21-1553-4578-82c5-78990df6b8e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:13.306913 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c4f21-1553-4578-82c5-78990df6b8e3 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:13.368220 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 616/1238] 10.222.0.40 () {60 vars in 1153 bytes} [Sun Oct 30 00:55:13 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:55:13.369513 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcfb9b-340d-435d-b48e-e706bd7364c5 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:13.385379 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcfb9b-340d-435d-b48e-e706bd7364c5 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:13.478436 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c538ff2-07e5-42ab-830c-ea21f9d8816e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:13.479403 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c538ff2-07e5-42ab-830c-ea21f9d8816e admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:13.479561 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c538ff2-07e5-42ab-830c-ea21f9d8816e admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:13.479944 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c538ff2-07e5-42ab-830c-ea21f9d8816e admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:13.480686 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c538ff2-07e5-42ab-830c-ea21f9d8816e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:13.482979 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c538ff2-07e5-42ab-830c-ea21f9d8816e admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:13.522571 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 623/1239] 10.222.0.40 () {60 vars in 1144 bytes} [Sun Oct 30 00:55:13 2022] POST /identity/v3/users => generated 296 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:55:13.526364 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c4f21-1553-4578-82c5-78990df6b8e3 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:13.539843 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c4f21-1553-4578-82c5-78990df6b8e3 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:13.547037 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767a843-4972-495a-a887-b471543094ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:13.547673 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767a843-4972-495a-a887-b471543094ce admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:13.547950 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767a843-4972-495a-a887-b471543094ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:13.548221 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767a843-4972-495a-a887-b471543094ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:13.548868 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767a843-4972-495a-a887-b471543094ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:13.554981 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767a843-4972-495a-a887-b471543094ce admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:13.581225 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 617/1240] 10.222.0.40 () {58 vars in 1122 bytes} [Sun Oct 30 00:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:55:13.582476 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c538ff2-07e5-42ab-830c-ea21f9d8816e admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:13.594853 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c538ff2-07e5-42ab-830c-ea21f9d8816e admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:13.614685 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a121d-b4a9-46d7-b6a7-e9da570f0e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:13.620975 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a121d-b4a9-46d7-b6a7-e9da570f0e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:13.621604 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a121d-b4a9-46d7-b6a7-e9da570f0e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:13.622343 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a121d-b4a9-46d7-b6a7-e9da570f0e10 admin admin] PATH_INFO: `/v3/projects/ea7cb34b93f84071ae9d802741319c5c/users/12fce0a8db9f440685a5c53f066e4c84/roles/17d0330d6df84d3091d7ef234dfc4e6b` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:13.630695 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:13.672850 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a121d-b4a9-46d7-b6a7-e9da570f0e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea7cb34b93f84071ae9d802741319c5c, user_id=12fce0a8db9f440685a5c53f066e4c84, role_id=17d0330d6df84d3091d7ef234dfc4e6b)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:13.676535 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a121d-b4a9-46d7-b6a7-e9da570f0e10 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:13.702770 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e2594-a16c-4805-ba50-b458c53722c5 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:13.704110 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e2594-a16c-4805-ba50-b458c53722c5 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:13.704110 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e2594-a16c-4805-ba50-b458c53722c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:13.718103 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 624/1241] 10.222.0.40 () {60 vars in 1483 bytes} [Sun Oct 30 00:55:13 2022] PUT /identity/v3/projects/ea7cb34b93f84071ae9d802741319c5c/users/12fce0a8db9f440685a5c53f066e4c84/roles/17d0330d6df84d3091d7ef234dfc4e6b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:55:13.722099 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a121d-b4a9-46d7-b6a7-e9da570f0e10 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:13.772610 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-cb3e2594-a16c-4805-ba50-b458c53722c5 None None] MFA Rules not processed for user `b8a65aed5ee544979ee1b460a71c99f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:13.775270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-cb3e2594-a16c-4805-ba50-b458c53722c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:13.829794 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a121d-b4a9-46d7-b6a7-e9da570f0e10 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:13.840216 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedaf246-46e0-44e3-9da1-58626a3a70d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:13.840821 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedaf246-46e0-44e3-9da1-58626a3a70d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:13.841521 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedaf246-46e0-44e3-9da1-58626a3a70d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:13.841521 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedaf246-46e0-44e3-9da1-58626a3a70d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:13.842640 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedaf246-46e0-44e3-9da1-58626a3a70d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:13.844249 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedaf246-46e0-44e3-9da1-58626a3a70d7 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:13.859422 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 625/1242] 10.222.0.40 () {58 vars in 1122 bytes} [Sun Oct 30 00:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:55:13.860467 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedaf246-46e0-44e3-9da1-58626a3a70d7 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:13.871961 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedaf246-46e0-44e3-9da1-58626a3a70d7 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:13.879472 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90f6db-15ed-41e2-a4f9-6e712e9c9100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:13.883073 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90f6db-15ed-41e2-a4f9-6e712e9c9100 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:13.883073 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90f6db-15ed-41e2-a4f9-6e712e9c9100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:13.883073 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90f6db-15ed-41e2-a4f9-6e712e9c9100 admin admin] PATH_INFO: `/v3/projects/ea7cb34b93f84071ae9d802741319c5c/users/12fce0a8db9f440685a5c53f066e4c84/roles/17d0330d6df84d3091d7ef234dfc4e6b` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:13.885407 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90f6db-15ed-41e2-a4f9-6e712e9c9100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea7cb34b93f84071ae9d802741319c5c, user_id=12fce0a8db9f440685a5c53f066e4c84, role_id=17d0330d6df84d3091d7ef234dfc4e6b)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:13.889113 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90f6db-15ed-41e2-a4f9-6e712e9c9100 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:13.896124 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 618/1243] 10.222.0.40 () {58 vars in 958 bytes} [Sun Oct 30 00:55:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:55:13.900380 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e2594-a16c-4805-ba50-b458c53722c5 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:13.912998 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e2594-a16c-4805-ba50-b458c53722c5 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:13.915364 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 626/1244] 10.222.0.40 () {60 vars in 1483 bytes} [Sun Oct 30 00:55:13 2022] PUT /identity/v3/projects/ea7cb34b93f84071ae9d802741319c5c/users/12fce0a8db9f440685a5c53f066e4c84/roles/17d0330d6df84d3091d7ef234dfc4e6b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:55:13.971546 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:14.003495 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbba18-ebd2-4f3c-891c-0df5004618bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:14.004911 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbba18-ebd2-4f3c-891c-0df5004618bf admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:14.005348 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbba18-ebd2-4f3c-891c-0df5004618bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:14.005817 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbba18-ebd2-4f3c-891c-0df5004618bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:14.006759 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cbba18-ebd2-4f3c-891c-0df5004618bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:14.008936 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cbba18-ebd2-4f3c-891c-0df5004618bf admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:14.048424 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 619/1245] 10.222.0.40 () {60 vars in 1153 bytes} [Sun Oct 30 00:55:13 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:55:14.049681 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90f6db-15ed-41e2-a4f9-6e712e9c9100 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:14.062133 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90f6db-15ed-41e2-a4f9-6e712e9c9100 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:14.131586 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388708db-bc53-4bc6-b7d4-2dfa74927e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:14.132525 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388708db-bc53-4bc6-b7d4-2dfa74927e6e admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:14.132786 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388708db-bc53-4bc6-b7d4-2dfa74927e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:14.133288 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388708db-bc53-4bc6-b7d4-2dfa74927e6e admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:14.134137 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388708db-bc53-4bc6-b7d4-2dfa74927e6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:14.136674 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388708db-bc53-4bc6-b7d4-2dfa74927e6e admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:14.167991 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 627/1246] 10.222.0.40 () {60 vars in 1144 bytes} [Sun Oct 30 00:55:14 2022] POST /identity/v3/users => generated 298 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:55:14.172598 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbba18-ebd2-4f3c-891c-0df5004618bf admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:14.184965 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbba18-ebd2-4f3c-891c-0df5004618bf admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:14.193667 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c7f63-f9c3-439f-a5dc-3bfc4393686e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:14.194618 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c7f63-f9c3-439f-a5dc-3bfc4393686e admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:14.195129 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c7f63-f9c3-439f-a5dc-3bfc4393686e admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:14.195619 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c7f63-f9c3-439f-a5dc-3bfc4393686e admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:14.197024 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c7f63-f9c3-439f-a5dc-3bfc4393686e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:14.200183 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c7f63-f9c3-439f-a5dc-3bfc4393686e admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:14.222195 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 620/1247] 10.222.0.40 () {58 vars in 1122 bytes} [Sun Oct 30 00:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:55:14.224362 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388708db-bc53-4bc6-b7d4-2dfa74927e6e admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:14.244461 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388708db-bc53-4bc6-b7d4-2dfa74927e6e admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:14.256518 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5cb1b-b9fa-43a0-8268-a77f0b9aa5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:14.257429 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5cb1b-b9fa-43a0-8268-a77f0b9aa5d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:14.257895 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5cb1b-b9fa-43a0-8268-a77f0b9aa5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:14.258302 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5cb1b-b9fa-43a0-8268-a77f0b9aa5d7 admin admin] PATH_INFO: `/v3/projects/b8b2d19b36e74a6f8ee67ae1dd7b5762/users/f219b8c3152040b38e4a5ed26a494651/roles/17d0330d6df84d3091d7ef234dfc4e6b` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:14.286251 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5cb1b-b9fa-43a0-8268-a77f0b9aa5d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b2d19b36e74a6f8ee67ae1dd7b5762, user_id=f219b8c3152040b38e4a5ed26a494651, role_id=17d0330d6df84d3091d7ef234dfc4e6b)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:14.289851 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5cb1b-b9fa-43a0-8268-a77f0b9aa5d7 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:14.318933 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 628/1248] 10.222.0.40 () {60 vars in 1483 bytes} [Sun Oct 30 00:55:14 2022] PUT /identity/v3/projects/b8b2d19b36e74a6f8ee67ae1dd7b5762/users/f219b8c3152040b38e4a5ed26a494651/roles/17d0330d6df84d3091d7ef234dfc4e6b => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:55:14.320923 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c7f63-f9c3-439f-a5dc-3bfc4393686e admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:14.337762 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c7f63-f9c3-439f-a5dc-3bfc4393686e admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:14.423231 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c5bb4-ad46-41e5-a7e9-be4eaf9c7818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:14.424210 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c5bb4-ad46-41e5-a7e9-be4eaf9c7818 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:14.424667 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c5bb4-ad46-41e5-a7e9-be4eaf9c7818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:14.425035 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c5bb4-ad46-41e5-a7e9-be4eaf9c7818 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:14.425990 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c5bb4-ad46-41e5-a7e9-be4eaf9c7818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:14.427977 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c5bb4-ad46-41e5-a7e9-be4eaf9c7818 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:14.456936 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 621/1249] 10.222.0.40 () {58 vars in 1122 bytes} [Sun Oct 30 00:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:55:14.460968 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5cb1b-b9fa-43a0-8268-a77f0b9aa5d7 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:14.479359 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5cb1b-b9fa-43a0-8268-a77f0b9aa5d7 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:14.511121 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d54c0-e3e2-4932-9c8b-e2ea979ddebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:14.511828 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d54c0-e3e2-4932-9c8b-e2ea979ddebc admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:14.512106 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d54c0-e3e2-4932-9c8b-e2ea979ddebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:14.512404 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d54c0-e3e2-4932-9c8b-e2ea979ddebc admin admin] PATH_INFO: `/v3/projects/b8b2d19b36e74a6f8ee67ae1dd7b5762/users/f219b8c3152040b38e4a5ed26a494651/roles/17d0330d6df84d3091d7ef234dfc4e6b` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:14.514794 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d54c0-e3e2-4932-9c8b-e2ea979ddebc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b2d19b36e74a6f8ee67ae1dd7b5762, user_id=f219b8c3152040b38e4a5ed26a494651, role_id=17d0330d6df84d3091d7ef234dfc4e6b)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:14.517859 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d54c0-e3e2-4932-9c8b-e2ea979ddebc admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:14.531001 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 629/1250] 10.222.0.40 () {60 vars in 1483 bytes} [Sun Oct 30 00:55:14 2022] PUT /identity/v3/projects/b8b2d19b36e74a6f8ee67ae1dd7b5762/users/f219b8c3152040b38e4a5ed26a494651/roles/17d0330d6df84d3091d7ef234dfc4e6b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:55:20.121995 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c57b0-0212-4770-b954-1e26b11f7761 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:20.122654 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c57b0-0212-4770-b954-1e26b11f7761 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:20.122654 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c57b0-0212-4770-b954-1e26b11f7761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:20.161407 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-1a4c57b0-0212-4770-b954-1e26b11f7761 None None] MFA Rules not processed for user `12fce0a8db9f440685a5c53f066e4c84`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:20.163588 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-1a4c57b0-0212-4770-b954-1e26b11f7761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:20.265270 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 622/1251] 10.222.0.40 () {58 vars in 958 bytes} [Sun Oct 30 00:55:20 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:55:20.287802 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d54c0-e3e2-4932-9c8b-e2ea979ddebc admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:20.291009 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-105d54c0-e3e2-4932-9c8b-e2ea979ddebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:20.326622 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:20.403597 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d54c0-e3e2-4932-9c8b-e2ea979ddebc admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:20.408578 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281f56a-efa8-4ed7-a3ef-3d62e23b3e01 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ae56497684fc08f05c65a3c23e898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:20.409179 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281f56a-efa8-4ed7-a3ef-3d62e23b3e01 service glance] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:20.409483 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281f56a-efa8-4ed7-a3ef-3d62e23b3e01 service glance] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:20.409756 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281f56a-efa8-4ed7-a3ef-3d62e23b3e01 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:20.494859 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281f56a-efa8-4ed7-a3ef-3d62e23b3e01 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:20.498320 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281f56a-efa8-4ed7-a3ef-3d62e23b3e01 service glance] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:20.511875 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 630/1252] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:55:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:55:21.254411 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ce2a4-710d-4eea-94e0-8aaefda403f8 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:21.255243 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ce2a4-710d-4eea-94e0-8aaefda403f8 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:21.255659 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ce2a4-710d-4eea-94e0-8aaefda403f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:21.290468 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-6a4ce2a4-710d-4eea-94e0-8aaefda403f8 None None] MFA Rules not processed for user `f219b8c3152040b38e4a5ed26a494651`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:21.291687 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-6a4ce2a4-710d-4eea-94e0-8aaefda403f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:21.327968 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:21.387895 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 623/1253] 10.222.0.40 () {58 vars in 958 bytes} [Sun Oct 30 00:55:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:55:21.401181 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281f56a-efa8-4ed7-a3ef-3d62e23b3e01 service glance] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:21.416513 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281f56a-efa8-4ed7-a3ef-3d62e23b3e01 service glance] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:21.421926 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae1917-9b21-4574-b740-414496f27869 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ae56497684fc08f05c65a3c23e898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:21.422840 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae1917-9b21-4574-b740-414496f27869 service glance] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:21.423163 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae1917-9b21-4574-b740-414496f27869 service glance] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:21.423607 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae1917-9b21-4574-b740-414496f27869 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:21.509100 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae1917-9b21-4574-b740-414496f27869 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:21.511361 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae1917-9b21-4574-b740-414496f27869 service glance] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:21.529404 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 631/1254] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:55:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:55:21.727250 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e48020-cb1b-425b-ae97-aa950d31ac49 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:21.727250 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e48020-cb1b-425b-ae97-aa950d31ac49 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:21.727514 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e48020-cb1b-425b-ae97-aa950d31ac49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:21.784587 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-61e48020-cb1b-425b-ae97-aa950d31ac49 None None] MFA Rules not processed for user `c625c9434922494aa868f1a5511963f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:21.785838 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-61e48020-cb1b-425b-ae97-aa950d31ac49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:21.876085 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 624/1255] 10.222.0.40 () {58 vars in 1009 bytes} [Sun Oct 30 00:55:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:55:21.999393 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae1917-9b21-4574-b740-414496f27869 service glance] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:22.000936 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fbae1917-9b21-4574-b740-414496f27869 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:22.076323 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb1b03-e2f0-4865-8802-28048bfc850b None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:22.077112 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb1b03-e2f0-4865-8802-28048bfc850b None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:22.077625 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:22.078163 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb1b03-e2f0-4865-8802-28048bfc850b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:22.102240 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-a4bb1b03-e2f0-4865-8802-28048bfc850b None None] MFA Rules not processed for user `c625c9434922494aa868f1a5511963f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:22.103887 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a4bb1b03-e2f0-4865-8802-28048bfc850b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:22.113959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 625/1256] 10.222.0.40 () {58 vars in 1009 bytes} [Sun Oct 30 00:55:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:55:22.116173 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae1917-9b21-4574-b740-414496f27869 service glance] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:22.122164 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327161f9-87c9-4fd8-8480-c19b4bfe0e51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b996b01e045b4034be43a907536079c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:22.122795 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327161f9-87c9-4fd8-8480-c19b4bfe0e51 service swift] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:22.122992 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327161f9-87c9-4fd8-8480-c19b4bfe0e51 service swift] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:22.123280 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327161f9-87c9-4fd8-8480-c19b4bfe0e51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:22.131646 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb1b03-e2f0-4865-8802-28048bfc850b None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:22.133117 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327161f9-87c9-4fd8-8480-c19b4bfe0e51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:22.134841 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327161f9-87c9-4fd8-8480-c19b4bfe0e51 service swift] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:22.144480 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 632/1257] 10.222.0.40 () {60 vars in 1384 bytes} [Sun Oct 30 00:55:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 00:55:22.145770 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb1b03-e2f0-4865-8802-28048bfc850b None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:22.152206 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aeb98e-309c-4302-850e-233103c3f8b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b996b01e045b4034be43a907536079c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:22.152825 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aeb98e-309c-4302-850e-233103c3f8b6 service swift] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:22.153147 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aeb98e-309c-4302-850e-233103c3f8b6 service swift] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:22.153599 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aeb98e-309c-4302-850e-233103c3f8b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:22.168128 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aeb98e-309c-4302-850e-233103c3f8b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:22.170492 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aeb98e-309c-4302-850e-233103c3f8b6 service swift] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:22.180539 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 626/1258] 10.222.0.40 () {60 vars in 1384 bytes} [Sun Oct 30 00:55:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 30 00:55:31.939010 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da46f5c-37d7-4a73-8db7-3a138eb66748 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:31.939710 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da46f5c-37d7-4a73-8db7-3a138eb66748 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:31.939710 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da46f5c-37d7-4a73-8db7-3a138eb66748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:31.960995 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-2da46f5c-37d7-4a73-8db7-3a138eb66748 None None] MFA Rules not processed for user `b8a65aed5ee544979ee1b460a71c99f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:31.962269 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2da46f5c-37d7-4a73-8db7-3a138eb66748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:31.969828 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 633/1259] 10.222.0.40 () {58 vars in 958 bytes} [Sun Oct 30 00:55:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:55:32.180759 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=64 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:32.295319 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cf5a0-8b31-4a00-9985-e8522fc4e15e None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:32.295674 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cf5a0-8b31-4a00-9985-e8522fc4e15e None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:32.296022 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cf5a0-8b31-4a00-9985-e8522fc4e15e None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:32.298302 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 627/1260] 10.222.0.40 () {54 vars in 961 bytes} [Sun Oct 30 00:55:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:55:32.308013 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cbab4-cdf2-4ca3-a3b7-5fa7c58615ed None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:32.308222 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cbab4-cdf2-4ca3-a3b7-5fa7c58615ed None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:32.308505 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cbab4-cdf2-4ca3-a3b7-5fa7c58615ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:32.364362 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-751cbab4-cdf2-4ca3-a3b7-5fa7c58615ed None None] MFA Rules not processed for user `4237b425d9fa4a60b10802e5b108d542`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:32.365615 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-751cbab4-cdf2-4ca3-a3b7-5fa7c58615ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:32.462507 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 634/1261] 10.222.0.40 () {58 vars in 1058 bytes} [Sun Oct 30 00:55:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:55:32.468439 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93952da0-dcae-4e6b-b8ac-73ffc16c0098 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:32.468755 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93952da0-dcae-4e6b-b8ac-73ffc16c0098 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:32.469028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93952da0-dcae-4e6b-b8ac-73ffc16c0098 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:32.470727 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 628/1262] 10.222.0.40 () {54 vars in 912 bytes} [Sun Oct 30 00:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:55:32.475964 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fed87d-24b3-4d32-8ae4-130ba582ed70 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:32.476255 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fed87d-24b3-4d32-8ae4-130ba582ed70 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:32.477067 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fed87d-24b3-4d32-8ae4-130ba582ed70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:32.499180 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-c7fed87d-24b3-4d32-8ae4-130ba582ed70 None None] MFA Rules not processed for user `4237b425d9fa4a60b10802e5b108d542`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:32.500704 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c7fed87d-24b3-4d32-8ae4-130ba582ed70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:32.513478 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 635/1263] 10.222.0.40 () {58 vars in 1009 bytes} [Sun Oct 30 00:55:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:55:32.525843 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93952da0-dcae-4e6b-b8ac-73ffc16c0098 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:32.527733 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-93952da0-dcae-4e6b-b8ac-73ffc16c0098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:32.546101 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93952da0-dcae-4e6b-b8ac-73ffc16c0098 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:32.550175 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95e52e-b6df-4c0a-8644-bb61b29dec00 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ae56497684fc08f05c65a3c23e898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:32.550822 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95e52e-b6df-4c0a-8644-bb61b29dec00 service glance] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:32.551168 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95e52e-b6df-4c0a-8644-bb61b29dec00 service glance] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:32.551510 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95e52e-b6df-4c0a-8644-bb61b29dec00 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:32.564805 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95e52e-b6df-4c0a-8644-bb61b29dec00 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:32.566495 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95e52e-b6df-4c0a-8644-bb61b29dec00 service glance] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:32.589328 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 629/1264] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:55:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:55:32.992377 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583a273-f6d9-4362-b258-cff2fc314c0b None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:32.992917 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583a273-f6d9-4362-b258-cff2fc314c0b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:32.993020 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583a273-f6d9-4362-b258-cff2fc314c0b None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:32.994531 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 636/1265] 10.222.0.40 () {54 vars in 912 bytes} [Sun Oct 30 00:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:55:33.000340 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4e9ee-4e56-4e59-8424-0262794f3f42 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:33.000628 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4e9ee-4e56-4e59-8424-0262794f3f42 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:33.000902 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4e9ee-4e56-4e59-8424-0262794f3f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:33.066536 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-66b4e9ee-4e56-4e59-8424-0262794f3f42 None None] MFA Rules not processed for user `93b5c95d6fd64262849f4c09fe0a716f`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:33.067784 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-66b4e9ee-4e56-4e59-8424-0262794f3f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:33.130134 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 630/1266] 10.222.0.40 () {58 vars in 1009 bytes} [Sun Oct 30 00:55:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:55:33.142257 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583a273-f6d9-4362-b258-cff2fc314c0b None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:33.154115 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583a273-f6d9-4362-b258-cff2fc314c0b None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:33.157956 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc79fb-1fd8-4778-8f78-fbbaf5176e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:33.158839 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc79fb-1fd8-4778-8f78-fbbaf5176e82 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:33.159117 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc79fb-1fd8-4778-8f78-fbbaf5176e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:33.159380 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc79fb-1fd8-4778-8f78-fbbaf5176e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:33.166297 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc79fb-1fd8-4778-8f78-fbbaf5176e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:33.167707 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc79fb-1fd8-4778-8f78-fbbaf5176e82 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:33.175523 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 637/1267] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:55:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:55:33.564583 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1936f9-41df-42f1-9303-91bfed317aad None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:33.565601 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1936f9-41df-42f1-9303-91bfed317aad None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:33.565947 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1936f9-41df-42f1-9303-91bfed317aad None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:33.567600 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 631/1268] 10.222.0.40 () {54 vars in 961 bytes} [Sun Oct 30 00:55:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:55:33.580968 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430154e-1a43-4edd-a0d5-6d3ef73e100b None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:33.581358 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430154e-1a43-4edd-a0d5-6d3ef73e100b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:33.581695 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430154e-1a43-4edd-a0d5-6d3ef73e100b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:33.593575 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1936f9-41df-42f1-9303-91bfed317aad None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:33.603037 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-7430154e-1a43-4edd-a0d5-6d3ef73e100b None None] MFA Rules not processed for user `4237b425d9fa4a60b10802e5b108d542`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:33.604237 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7430154e-1a43-4edd-a0d5-6d3ef73e100b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:33.613543 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 638/1269] 10.222.0.40 () {58 vars in 1058 bytes} [Sun Oct 30 00:55:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:55:33.619031 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb9e5b-c0ef-41fc-aecf-b659daa90ef0 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:33.619386 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb9e5b-c0ef-41fc-aecf-b659daa90ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:33.619906 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb9e5b-c0ef-41fc-aecf-b659daa90ef0 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:33.621072 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 639/1270] 10.222.0.40 () {54 vars in 912 bytes} [Sun Oct 30 00:55:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:55:33.625864 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c29ef7-4d01-43ab-921c-a4b2273fe6d8 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:33.626243 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c29ef7-4d01-43ab-921c-a4b2273fe6d8 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:33.626588 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c29ef7-4d01-43ab-921c-a4b2273fe6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:33.646363 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-18c29ef7-4d01-43ab-921c-a4b2273fe6d8 None None] MFA Rules not processed for user `4237b425d9fa4a60b10802e5b108d542`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:33.647602 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-18c29ef7-4d01-43ab-921c-a4b2273fe6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:33.657789 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 640/1271] 10.222.0.40 () {58 vars in 1009 bytes} [Sun Oct 30 00:55:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:55:33.669542 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c29ef7-4d01-43ab-921c-a4b2273fe6d8 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:33.670109 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1936f9-41df-42f1-9303-91bfed317aad None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:33.676292 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171b6df-b565-4ae1-b310-d13739e6b1e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7f009bdf1d24ee4b879db926b8d44cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:33.677016 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171b6df-b565-4ae1-b310-d13739e6b1e2 service placement] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:33.677330 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171b6df-b565-4ae1-b310-d13739e6b1e2 service placement] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:33.677626 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171b6df-b565-4ae1-b310-d13739e6b1e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:33.679431 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-6171b6df-b565-4ae1-b310-d13739e6b1e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:33.679621 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c29ef7-4d01-43ab-921c-a4b2273fe6d8 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:33.683254 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bad99c-edd2-48bb-9b77-06407883c9b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:33.684090 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bad99c-edd2-48bb-9b77-06407883c9b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:33.684090 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bad99c-edd2-48bb-9b77-06407883c9b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:33.684366 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bad99c-edd2-48bb-9b77-06407883c9b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:33.692271 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171b6df-b565-4ae1-b310-d13739e6b1e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:33.694021 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171b6df-b565-4ae1-b310-d13739e6b1e2 service placement] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:33.695346 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bad99c-edd2-48bb-9b77-06407883c9b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:33.696847 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bad99c-edd2-48bb-9b77-06407883c9b1 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:33.704446 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 632/1272] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:55:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:55:33.709157 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 641/1273] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:55:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:55:35.448114 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b4a2a-dbfa-475a-8402-991d8d2260ef None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:35.448627 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b4a2a-dbfa-475a-8402-991d8d2260ef None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:35.448627 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b4a2a-dbfa-475a-8402-991d8d2260ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:35.470395 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-f00b4a2a-dbfa-475a-8402-991d8d2260ef None None] MFA Rules not processed for user `c625c9434922494aa868f1a5511963f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:35.471604 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-f00b4a2a-dbfa-475a-8402-991d8d2260ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:35.479269 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 633/1274] 10.222.0.40 () {58 vars in 1009 bytes} [Sun Oct 30 00:55:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:55:35.492921 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bad99c-edd2-48bb-9b77-06407883c9b1 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:35.504495 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bad99c-edd2-48bb-9b77-06407883c9b1 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:35.513627 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbec04-7cd1-4c13-9fc9-950f85ad864b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b996b01e045b4034be43a907536079c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:35.514603 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbec04-7cd1-4c13-9fc9-950f85ad864b service swift] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:35.515086 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbec04-7cd1-4c13-9fc9-950f85ad864b service swift] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:35.515601 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbec04-7cd1-4c13-9fc9-950f85ad864b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:35.526021 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bbec04-7cd1-4c13-9fc9-950f85ad864b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:35.527565 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bbec04-7cd1-4c13-9fc9-950f85ad864b service swift] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:35.555376 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 642/1275] 10.222.0.40 () {60 vars in 1384 bytes} [Sun Oct 30 00:55:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 00:55:44.390946 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7829c-86e2-453f-ba8a-381581fd2373 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:44.391584 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7829c-86e2-453f-ba8a-381581fd2373 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:44.391949 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7829c-86e2-453f-ba8a-381581fd2373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:44.411967 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-68a7829c-86e2-453f-ba8a-381581fd2373 None None] MFA Rules not processed for user `93b5c95d6fd64262849f4c09fe0a716f`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:44.413143 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-68a7829c-86e2-453f-ba8a-381581fd2373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:44.419487 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 634/1276] 10.222.0.52 () {58 vars in 1015 bytes} [Sun Oct 30 00:55:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:55:44.434134 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbec04-7cd1-4c13-9fc9-950f85ad864b service swift] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:44.444844 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbec04-7cd1-4c13-9fc9-950f85ad864b service swift] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:44.448568 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd4dfb-0864-418f-b893-042c8fcc87b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:44.449154 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd4dfb-0864-418f-b893-042c8fcc87b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:44.449458 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd4dfb-0864-418f-b893-042c8fcc87b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:44.449792 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd4dfb-0864-418f-b893-042c8fcc87b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:44.457813 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd4dfb-0864-418f-b893-042c8fcc87b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:44.459225 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd4dfb-0864-418f-b893-042c8fcc87b4 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:44.466851 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 643/1277] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:55:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:55:45.296378 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44837d-47c5-4749-8a60-fc6c201531c4 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:45.297006 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44837d-47c5-4749-8a60-fc6c201531c4 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:45.297445 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44837d-47c5-4749-8a60-fc6c201531c4 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:45.299343 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 635/1278] 10.222.0.40 () {54 vars in 921 bytes} [Sun Oct 30 00:55:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:55:45.345092 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea35ecf-e7e5-43fe-9aca-c6120d002330 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:45.345445 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea35ecf-e7e5-43fe-9aca-c6120d002330 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:45.345727 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea35ecf-e7e5-43fe-9aca-c6120d002330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:45.365548 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-4ea35ecf-e7e5-43fe-9aca-c6120d002330 None None] MFA Rules not processed for user `4237b425d9fa4a60b10802e5b108d542`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:45.366749 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4ea35ecf-e7e5-43fe-9aca-c6120d002330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:45.376214 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 644/1279] 10.222.0.40 () {58 vars in 1018 bytes} [Sun Oct 30 00:55:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:55:45.398242 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44837d-47c5-4749-8a60-fc6c201531c4 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:45.414617 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44837d-47c5-4749-8a60-fc6c201531c4 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:45.422116 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39295b7-e813-4a6b-a98a-fcfc5973008f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:45.422252 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39295b7-e813-4a6b-a98a-fcfc5973008f service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:45.422449 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39295b7-e813-4a6b-a98a-fcfc5973008f service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:45.422721 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39295b7-e813-4a6b-a98a-fcfc5973008f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:45.434507 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39295b7-e813-4a6b-a98a-fcfc5973008f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:45.434507 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39295b7-e813-4a6b-a98a-fcfc5973008f service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:45.444739 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 636/1280] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:55:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:55:52.415115 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6b1de-b628-447c-b379-0be86ad27dd5 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:52.415746 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6b1de-b628-447c-b379-0be86ad27dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:52.415746 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6b1de-b628-447c-b379-0be86ad27dd5 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:52.417836 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 645/1281] 10.222.0.40 () {54 vars in 921 bytes} [Sun Oct 30 00:55:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:55:52.524912 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fee2d2-7460-4663-bd08-759ce134ffa1 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:52.525548 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fee2d2-7460-4663-bd08-759ce134ffa1 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:52.525548 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fee2d2-7460-4663-bd08-759ce134ffa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:52.547789 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-14fee2d2-7460-4663-bd08-759ce134ffa1 None None] MFA Rules not processed for user `4237b425d9fa4a60b10802e5b108d542`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:52.549012 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-14fee2d2-7460-4663-bd08-759ce134ffa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:52.558229 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 637/1282] 10.222.0.40 () {58 vars in 1018 bytes} [Sun Oct 30 00:55:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:55:52.572139 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6b1de-b628-447c-b379-0be86ad27dd5 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:52.581300 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=94 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:52.588951 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6b1de-b628-447c-b379-0be86ad27dd5 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:52.595367 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6de8d-ea89-4045-8461-443d762d3da0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:52.595976 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6de8d-ea89-4045-8461-443d762d3da0 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:52.596251 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6de8d-ea89-4045-8461-443d762d3da0 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:52.596518 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6de8d-ea89-4045-8461-443d762d3da0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:52.607154 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6de8d-ea89-4045-8461-443d762d3da0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:52.608756 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6de8d-ea89-4045-8461-443d762d3da0 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:52.619828 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 646/1283] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:55:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:56:02.542840 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=82 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:02.615340 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=5 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:10.856355 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da4037-7dd5-47fb-a6f0-011baa1cdc05 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:10.856811 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da4037-7dd5-47fb-a6f0-011baa1cdc05 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:10.856918 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da4037-7dd5-47fb-a6f0-011baa1cdc05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:10.875929 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-08da4037-7dd5-47fb-a6f0-011baa1cdc05 None None] MFA Rules not processed for user `86918f2d1f5342eeb2b5d3ab5048296c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:56:10.877151 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-08da4037-7dd5-47fb-a6f0-011baa1cdc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:10.883942 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 638/1284] 10.222.0.40 () {58 vars in 958 bytes} [Sun Oct 30 00:56:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:56:13.767354 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6de8d-ea89-4045-8461-443d762d3da0 service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:13.778619 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6de8d-ea89-4045-8461-443d762d3da0 service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:13.783850 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d750f02-e3a4-428c-9cc3-c20e250ba442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:13.784681 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d750f02-e3a4-428c-9cc3-c20e250ba442 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:13.785310 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d750f02-e3a4-428c-9cc3-c20e250ba442 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:13.786044 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d750f02-e3a4-428c-9cc3-c20e250ba442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:13.797389 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d750f02-e3a4-428c-9cc3-c20e250ba442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:13.799373 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d750f02-e3a4-428c-9cc3-c20e250ba442 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:13.823042 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 647/1285] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:56:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:56:15.897727 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc210f-0c38-4024-be83-68a395fc524b None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:15.898239 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc210f-0c38-4024-be83-68a395fc524b None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:15.898239 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc210f-0c38-4024-be83-68a395fc524b None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:15.899795 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 639/1286] 10.222.0.40 () {54 vars in 921 bytes} [Sun Oct 30 00:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:56:15.905498 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c866088-69b4-439e-b32d-d368895eb188 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:15.905977 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c866088-69b4-439e-b32d-d368895eb188 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:15.906049 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c866088-69b4-439e-b32d-d368895eb188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:15.931759 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-4c866088-69b4-439e-b32d-d368895eb188 None None] MFA Rules not processed for user `4237b425d9fa4a60b10802e5b108d542`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:56:15.935104 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4c866088-69b4-439e-b32d-d368895eb188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:15.947569 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 648/1287] 10.222.0.40 () {58 vars in 1018 bytes} [Sun Oct 30 00:56:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:56:15.971945 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc210f-0c38-4024-be83-68a395fc524b None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:15.988756 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc210f-0c38-4024-be83-68a395fc524b None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:15.995792 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0859994-e1be-47a2-9d6e-974290fdb075 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:15.996407 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0859994-e1be-47a2-9d6e-974290fdb075 service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:15.996811 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0859994-e1be-47a2-9d6e-974290fdb075 service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:15.997066 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0859994-e1be-47a2-9d6e-974290fdb075 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:16.008477 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0859994-e1be-47a2-9d6e-974290fdb075 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:16.010335 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0859994-e1be-47a2-9d6e-974290fdb075 service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:16.023292 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 640/1288] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:56:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:56:25.924812 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=9 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:26.018394 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=9 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:52.213730 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05a773-a680-4057-b854-7727ccdebe73 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:52.214235 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05a773-a680-4057-b854-7727ccdebe73 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:52.214350 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05a773-a680-4057-b854-7727ccdebe73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:52.232681 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-db05a773-a680-4057-b854-7727ccdebe73 None None] MFA Rules not processed for user `86918f2d1f5342eeb2b5d3ab5048296c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:56:52.233916 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-db05a773-a680-4057-b854-7727ccdebe73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:52.241053 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 649/1289] 10.222.0.40 () {58 vars in 958 bytes} [Sun Oct 30 00:56:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:57:02.227425 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:09.178734 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed5041-3a44-44a9-a41f-c3c81bc9f362 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:09.179402 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed5041-3a44-44a9-a41f-c3c81bc9f362 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:09.179686 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed5041-3a44-44a9-a41f-c3c81bc9f362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:09.199399 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-a2ed5041-3a44-44a9-a41f-c3c81bc9f362 None None] MFA Rules not processed for user `c625c9434922494aa868f1a5511963f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:57:09.200660 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a2ed5041-3a44-44a9-a41f-c3c81bc9f362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:09.208578 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 641/1290] 10.222.0.40 () {58 vars in 1009 bytes} [Sun Oct 30 00:57:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:57:09.248618 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05a773-a680-4057-b854-7727ccdebe73 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:09.261019 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05a773-a680-4057-b854-7727ccdebe73 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:09.265988 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1110599-d937-44e5-9c9c-ffce21ed4bcc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b996b01e045b4034be43a907536079c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:09.266607 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1110599-d937-44e5-9c9c-ffce21ed4bcc service swift] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:09.266884 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1110599-d937-44e5-9c9c-ffce21ed4bcc service swift] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:09.267152 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1110599-d937-44e5-9c9c-ffce21ed4bcc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:09.275617 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1110599-d937-44e5-9c9c-ffce21ed4bcc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:09.277197 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1110599-d937-44e5-9c9c-ffce21ed4bcc service swift] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:09.285344 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 650/1291] 10.222.0.40 () {60 vars in 1384 bytes} [Sun Oct 30 00:57:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 00:57:12.600851 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eec10b-d07e-4d59-9200-1d6b9746ea35 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:12.601355 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eec10b-d07e-4d59-9200-1d6b9746ea35 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:12.601447 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eec10b-d07e-4d59-9200-1d6b9746ea35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:12.620221 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-c2eec10b-d07e-4d59-9200-1d6b9746ea35 None None] MFA Rules not processed for user `86918f2d1f5342eeb2b5d3ab5048296c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:57:12.621444 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c2eec10b-d07e-4d59-9200-1d6b9746ea35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:12.628685 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 642/1292] 10.222.0.40 () {58 vars in 958 bytes} [Sun Oct 30 00:57:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:57:12.897091 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dac03e-7b03-4a3c-909c-2dfa2eb47d87 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:12.897606 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dac03e-7b03-4a3c-909c-2dfa2eb47d87 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:12.897719 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dac03e-7b03-4a3c-909c-2dfa2eb47d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:12.917588 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-90dac03e-7b03-4a3c-909c-2dfa2eb47d87 None None] MFA Rules not processed for user `93b5c95d6fd64262849f4c09fe0a716f`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:57:12.918792 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-90dac03e-7b03-4a3c-909c-2dfa2eb47d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:12.925944 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 651/1293] 10.222.0.40 () {58 vars in 1009 bytes} [Sun Oct 30 00:57:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:57:12.936968 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eec10b-d07e-4d59-9200-1d6b9746ea35 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:12.946245 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eec10b-d07e-4d59-9200-1d6b9746ea35 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:12.949729 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8421b33-0276-44f3-9c0b-643db4c1e294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:12.950315 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8421b33-0276-44f3-9c0b-643db4c1e294 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:12.950590 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8421b33-0276-44f3-9c0b-643db4c1e294 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:12.950860 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8421b33-0276-44f3-9c0b-643db4c1e294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:12.957657 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8421b33-0276-44f3-9c0b-643db4c1e294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:12.959070 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8421b33-0276-44f3-9c0b-643db4c1e294 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:12.966604 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 643/1294] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:57:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:57:22.912554 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=9 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:22.963201 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=12 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:39.793110 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8a3ee-1b3c-4c14-9fe2-e5a50879c14f None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:39.793638 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8a3ee-1b3c-4c14-9fe2-e5a50879c14f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:39.793798 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8a3ee-1b3c-4c14-9fe2-e5a50879c14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:39.813143 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-f2f8a3ee-1b3c-4c14-9fe2-e5a50879c14f None None] MFA Rules not processed for user `c625c9434922494aa868f1a5511963f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:57:39.814336 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f2f8a3ee-1b3c-4c14-9fe2-e5a50879c14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:39.821272 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 652/1295] 10.222.0.40 () {58 vars in 967 bytes} [Sun Oct 30 00:57:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:57:39.834014 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8421b33-0276-44f3-9c0b-643db4c1e294 service neutron] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:39.845783 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8421b33-0276-44f3-9c0b-643db4c1e294 service neutron] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:39.851376 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509055b4-4b57-4c41-b883-7ccdf8394ecc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b996b01e045b4034be43a907536079c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:39.851965 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509055b4-4b57-4c41-b883-7ccdf8394ecc service swift] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:39.852291 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509055b4-4b57-4c41-b883-7ccdf8394ecc service swift] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:39.852569 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509055b4-4b57-4c41-b883-7ccdf8394ecc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:39.860659 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509055b4-4b57-4c41-b883-7ccdf8394ecc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:39.862247 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509055b4-4b57-4c41-b883-7ccdf8394ecc service swift] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:39.870742 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 644/1296] 10.222.0.40 () {60 vars in 1384 bytes} [Sun Oct 30 00:57:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 00:57:49.808028 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:49.867570 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=6 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:57.443150 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2c8dd-fa98-4160-b5ec-6612ad34d35f None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:57.443632 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2c8dd-fa98-4160-b5ec-6612ad34d35f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:57.443722 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2c8dd-fa98-4160-b5ec-6612ad34d35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:57.462962 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-59c2c8dd-fa98-4160-b5ec-6612ad34d35f None None] MFA Rules not processed for user `86918f2d1f5342eeb2b5d3ab5048296c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:57:57.464145 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-59c2c8dd-fa98-4160-b5ec-6612ad34d35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:57.470943 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 653/1297] 10.222.0.40 () {58 vars in 958 bytes} [Sun Oct 30 00:57:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:58:07.457388 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:58:13.618743 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509055b4-4b57-4c41-b883-7ccdf8394ecc service swift] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:13.627591 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509055b4-4b57-4c41-b883-7ccdf8394ecc service swift] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:13.631783 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b450da-a365-4262-9de0-9b88a6def8f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:13.632366 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b450da-a365-4262-9de0-9b88a6def8f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:13.632638 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b450da-a365-4262-9de0-9b88a6def8f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:13.632909 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b450da-a365-4262-9de0-9b88a6def8f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:13.641711 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b450da-a365-4262-9de0-9b88a6def8f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:13.643123 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b450da-a365-4262-9de0-9b88a6def8f3 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:13.652233 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 645/1298] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:58:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:58:23.648155 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=6 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:58:33.471213 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c215698-c98e-4807-af46-5c7e8b526f45 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:33.471638 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c215698-c98e-4807-af46-5c7e8b526f45 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:33.471737 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c215698-c98e-4807-af46-5c7e8b526f45 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:33.473073 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 654/1299] 10.222.0.40 () {54 vars in 961 bytes} [Sun Oct 30 00:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:58:33.478538 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27652e45-b70d-4481-98df-271b52519729 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:33.478921 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27652e45-b70d-4481-98df-271b52519729 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:33.479081 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27652e45-b70d-4481-98df-271b52519729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:33.498792 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-27652e45-b70d-4481-98df-271b52519729 None None] MFA Rules not processed for user `d7f009bdf1d24ee4b879db926b8d44cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:58:33.499973 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-27652e45-b70d-4481-98df-271b52519729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:33.509399 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 646/1300] 10.222.0.40 () {58 vars in 1058 bytes} [Sun Oct 30 00:58:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:58:33.517570 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c215698-c98e-4807-af46-5c7e8b526f45 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:33.531679 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c215698-c98e-4807-af46-5c7e8b526f45 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:33.536477 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b16a5-3ba9-42a9-8647-02e855cb9189 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7f009bdf1d24ee4b879db926b8d44cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:33.537073 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b16a5-3ba9-42a9-8647-02e855cb9189 service placement] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:33.537381 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b16a5-3ba9-42a9-8647-02e855cb9189 service placement] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:33.537649 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b16a5-3ba9-42a9-8647-02e855cb9189 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:33.545696 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b16a5-3ba9-42a9-8647-02e855cb9189 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:33.547418 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b16a5-3ba9-42a9-8647-02e855cb9189 service placement] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:33.557416 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 655/1301] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 00:58:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:58:43.493920 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:58:43.553366 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=6 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:59:28.868914 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9c112-a32d-453c-9c80-aeb982fb5266 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:59:28.869402 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9c112-a32d-453c-9c80-aeb982fb5266 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:59:28.869492 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9c112-a32d-453c-9c80-aeb982fb5266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:59:28.888518 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-e8f9c112-a32d-453c-9c80-aeb982fb5266 None None] MFA Rules not processed for user `c625c9434922494aa868f1a5511963f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:59:28.889736 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-e8f9c112-a32d-453c-9c80-aeb982fb5266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:59:28.896653 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 647/1302] 10.222.0.40 () {58 vars in 967 bytes} [Sun Oct 30 00:59:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:59:28.941036 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b16a5-3ba9-42a9-8647-02e855cb9189 service placement] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:59:28.952754 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b16a5-3ba9-42a9-8647-02e855cb9189 service placement] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:59:28.957716 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22ef5d-ea6d-4496-8984-9b7ff824ead4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b996b01e045b4034be43a907536079c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:59:28.958300 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22ef5d-ea6d-4496-8984-9b7ff824ead4 service swift] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:59:28.958575 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22ef5d-ea6d-4496-8984-9b7ff824ead4 service swift] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:59:28.958844 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22ef5d-ea6d-4496-8984-9b7ff824ead4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:59:28.967339 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22ef5d-ea6d-4496-8984-9b7ff824ead4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:59:28.968906 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22ef5d-ea6d-4496-8984-9b7ff824ead4 service swift] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:59:28.977068 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 656/1303] 10.222.0.40 () {60 vars in 1384 bytes} [Sun Oct 30 00:59:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 00:59:29.451517 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535ff3b-9671-45ea-9d53-8defa1d56a56 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:59:29.451797 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535ff3b-9671-45ea-9d53-8defa1d56a56 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:59:29.452070 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535ff3b-9671-45ea-9d53-8defa1d56a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:59:29.471703 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-4535ff3b-9671-45ea-9d53-8defa1d56a56 None None] MFA Rules not processed for user `c625c9434922494aa868f1a5511963f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:59:29.472871 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-4535ff3b-9671-45ea-9d53-8defa1d56a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:59:29.479926 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 648/1304] 10.222.0.40 () {58 vars in 1009 bytes} [Sun Oct 30 00:59:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:59:29.491865 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22ef5d-ea6d-4496-8984-9b7ff824ead4 service swift] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:59:29.502099 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22ef5d-ea6d-4496-8984-9b7ff824ead4 service swift] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:59:29.507086 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aec05c-3895-4b04-baa0-3ebbdc312717 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b996b01e045b4034be43a907536079c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:59:29.507669 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aec05c-3895-4b04-baa0-3ebbdc312717 service swift] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:59:29.507965 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aec05c-3895-4b04-baa0-3ebbdc312717 service swift] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:59:29.508228 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aec05c-3895-4b04-baa0-3ebbdc312717 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:59:29.516828 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aec05c-3895-4b04-baa0-3ebbdc312717 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:59:29.518462 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aec05c-3895-4b04-baa0-3ebbdc312717 service swift] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:59:29.527360 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 657/1305] 10.222.0.40 () {60 vars in 1384 bytes} [Sun Oct 30 00:59:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 00:59:37.949345 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8bdcc-2d58-4314-be6d-0c2b1e00b41e None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:59:37.949836 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8bdcc-2d58-4314-be6d-0c2b1e00b41e None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:59:37.949917 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8bdcc-2d58-4314-be6d-0c2b1e00b41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:59:37.969100 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-b9e8bdcc-2d58-4314-be6d-0c2b1e00b41e None None] MFA Rules not processed for user `b8a65aed5ee544979ee1b460a71c99f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:59:37.970338 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-b9e8bdcc-2d58-4314-be6d-0c2b1e00b41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:59:37.977087 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 649/1306] 10.222.0.40 () {58 vars in 958 bytes} [Sun Oct 30 00:59:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:59:39.523399 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=12 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:59:39.746815 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989b076-bf25-4c57-b0e9-fdd71c865e22 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:59:39.747091 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989b076-bf25-4c57-b0e9-fdd71c865e22 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:59:39.747359 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989b076-bf25-4c57-b0e9-fdd71c865e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:59:39.766864 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-3989b076-bf25-4c57-b0e9-fdd71c865e22 None None] MFA Rules not processed for user `c625c9434922494aa868f1a5511963f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:59:39.768062 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3989b076-bf25-4c57-b0e9-fdd71c865e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:59:39.775240 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 658/1307] 10.222.0.40 () {58 vars in 1009 bytes} [Sun Oct 30 00:59:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:59:39.787210 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8bdcc-2d58-4314-be6d-0c2b1e00b41e None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:59:39.798824 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8bdcc-2d58-4314-be6d-0c2b1e00b41e None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:59:39.804115 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61421761-3604-43f6-bc8d-ea086b829092 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b996b01e045b4034be43a907536079c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:59:39.804711 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61421761-3604-43f6-bc8d-ea086b829092 service swift] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:59:39.804986 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61421761-3604-43f6-bc8d-ea086b829092 service swift] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:59:39.805279 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61421761-3604-43f6-bc8d-ea086b829092 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:59:39.813955 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61421761-3604-43f6-bc8d-ea086b829092 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:59:39.815524 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61421761-3604-43f6-bc8d-ea086b829092 service swift] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:59:39.824253 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 650/1308] 10.222.0.40 () {60 vars in 1384 bytes} [Sun Oct 30 00:59:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 00:59:49.761829 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:59:49.820317 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=15 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:00:16.414028 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3679e-07f9-4799-a9b1-c359f9b3d6eb None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:00:16.414503 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3679e-07f9-4799-a9b1-c359f9b3d6eb None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:00:16.414597 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3679e-07f9-4799-a9b1-c359f9b3d6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:00:16.435792 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-69f3679e-07f9-4799-a9b1-c359f9b3d6eb None None] MFA Rules not processed for user `86918f2d1f5342eeb2b5d3ab5048296c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:00:16.438061 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-69f3679e-07f9-4799-a9b1-c359f9b3d6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:00:16.444806 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 659/1309] 10.222.0.40 () {58 vars in 958 bytes} [Sun Oct 30 01:00:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:00:20.568579 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61421761-3604-43f6-bc8d-ea086b829092 service swift] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:00:20.580794 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61421761-3604-43f6-bc8d-ea086b829092 service swift] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:00:20.586233 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02262d91-4fbe-4177-8b53-61de4cd431fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:00:20.586796 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02262d91-4fbe-4177-8b53-61de4cd431fb service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:00:20.587166 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02262d91-4fbe-4177-8b53-61de4cd431fb service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:00:20.587441 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02262d91-4fbe-4177-8b53-61de4cd431fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:00:20.595022 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02262d91-4fbe-4177-8b53-61de4cd431fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:00:20.596605 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02262d91-4fbe-4177-8b53-61de4cd431fb service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:00:20.605415 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 651/1310] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 01:00:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:00:26.431149 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:00:30.601309 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=6 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:00:32.569484 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3679e-07f9-4799-a9b1-c359f9b3d6eb None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:00:32.578764 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3679e-07f9-4799-a9b1-c359f9b3d6eb None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:00:32.582331 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372ef9e-6ccd-41fb-9cb6-fe501bd70cda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:00:32.582953 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372ef9e-6ccd-41fb-9cb6-fe501bd70cda service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:00:32.583229 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372ef9e-6ccd-41fb-9cb6-fe501bd70cda service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:00:32.583498 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372ef9e-6ccd-41fb-9cb6-fe501bd70cda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:00:32.594020 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372ef9e-6ccd-41fb-9cb6-fe501bd70cda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:00:32.595422 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372ef9e-6ccd-41fb-9cb6-fe501bd70cda service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:00:32.605788 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 660/1311] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 01:00:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:00:32.936740 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02262d91-4fbe-4177-8b53-61de4cd431fb service nova] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:00:32.948245 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02262d91-4fbe-4177-8b53-61de4cd431fb service nova] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:00:32.954733 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7289f-2337-414d-86dd-b6b87d842b61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:00:32.955334 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7289f-2337-414d-86dd-b6b87d842b61 service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:00:32.955610 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7289f-2337-414d-86dd-b6b87d842b61 service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:00:32.955908 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7289f-2337-414d-86dd-b6b87d842b61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:00:32.963956 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7289f-2337-414d-86dd-b6b87d842b61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:00:32.965557 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7289f-2337-414d-86dd-b6b87d842b61 service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:00:32.974283 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 652/1312] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 01:00:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:00:35.832885 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372ef9e-6ccd-41fb-9cb6-fe501bd70cda service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:00:35.841418 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372ef9e-6ccd-41fb-9cb6-fe501bd70cda service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:00:35.845789 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aea387-1c20-46ee-bd82-87ab96a17dd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:00:35.846373 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aea387-1c20-46ee-bd82-87ab96a17dd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:00:35.846651 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aea387-1c20-46ee-bd82-87ab96a17dd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:00:35.846924 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aea387-1c20-46ee-bd82-87ab96a17dd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:00:35.856773 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aea387-1c20-46ee-bd82-87ab96a17dd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:00:35.858227 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aea387-1c20-46ee-bd82-87ab96a17dd5 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:00:35.868759 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 661/1313] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 01:00:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:00:42.970271 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=6 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:00:45.864159 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=12 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:01:23.742173 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7289f-2337-414d-86dd-b6b87d842b61 service nova] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:01:23.756080 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7289f-2337-414d-86dd-b6b87d842b61 service nova] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:01:23.761973 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e04bf2-5a22-4f35-b6e6-6db83140994b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:01:23.762828 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e04bf2-5a22-4f35-b6e6-6db83140994b service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:01:23.763244 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e04bf2-5a22-4f35-b6e6-6db83140994b service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:01:23.763584 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e04bf2-5a22-4f35-b6e6-6db83140994b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:01:23.775020 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e04bf2-5a22-4f35-b6e6-6db83140994b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:01:23.776908 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e04bf2-5a22-4f35-b6e6-6db83140994b service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:01:23.789101 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 653/1314] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 01:01:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:01:23.862623 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aea387-1c20-46ee-bd82-87ab96a17dd5 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:01:23.876034 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aea387-1c20-46ee-bd82-87ab96a17dd5 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:01:23.883322 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c5efe-38f8-4dc7-9ecf-5e25c8515422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:01:23.885075 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c5efe-38f8-4dc7-9ecf-5e25c8515422 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:01:23.885502 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c5efe-38f8-4dc7-9ecf-5e25c8515422 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:01:23.886262 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c5efe-38f8-4dc7-9ecf-5e25c8515422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:01:23.896757 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c5efe-38f8-4dc7-9ecf-5e25c8515422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:01:23.898602 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c5efe-38f8-4dc7-9ecf-5e25c8515422 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:01:23.911928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 662/1315] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 01:01:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:01:29.785944 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e04bf2-5a22-4f35-b6e6-6db83140994b service nova] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:01:29.797101 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e04bf2-5a22-4f35-b6e6-6db83140994b service nova] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:01:29.803032 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658d7bc-9eba-492b-a179-25f4ba5498b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:01:29.803624 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658d7bc-9eba-492b-a179-25f4ba5498b0 service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:01:29.803910 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658d7bc-9eba-492b-a179-25f4ba5498b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:01:29.804182 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658d7bc-9eba-492b-a179-25f4ba5498b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:01:29.813443 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658d7bc-9eba-492b-a179-25f4ba5498b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:01:29.815227 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658d7bc-9eba-492b-a179-25f4ba5498b0 service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:01:29.826128 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 654/1316] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 01:01:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:01:31.139497 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c1839-5479-4118-9b78-5f8d25ec294b None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:01:31.139960 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c1839-5479-4118-9b78-5f8d25ec294b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:01:31.140293 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c1839-5479-4118-9b78-5f8d25ec294b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:01:31.160856 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-555c1839-5479-4118-9b78-5f8d25ec294b None None] MFA Rules not processed for user `c625c9434922494aa868f1a5511963f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:01:31.162098 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-555c1839-5479-4118-9b78-5f8d25ec294b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:01:31.169316 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 663/1317] 10.222.0.40 () {58 vars in 967 bytes} [Sun Oct 30 01:01:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:01:31.209976 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658d7bc-9eba-492b-a179-25f4ba5498b0 service nova] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:01:31.221085 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658d7bc-9eba-492b-a179-25f4ba5498b0 service nova] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:01:31.226364 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94eed67-b7ad-4c9b-994d-9105ce27483f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b996b01e045b4034be43a907536079c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:01:31.226956 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94eed67-b7ad-4c9b-994d-9105ce27483f service swift] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:01:31.227234 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94eed67-b7ad-4c9b-994d-9105ce27483f service swift] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:01:31.227505 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94eed67-b7ad-4c9b-994d-9105ce27483f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:01:31.235457 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94eed67-b7ad-4c9b-994d-9105ce27483f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:01:31.237012 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94eed67-b7ad-4c9b-994d-9105ce27483f service swift] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:01:31.245096 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 655/1318] 10.222.0.40 () {60 vars in 1384 bytes} [Sun Oct 30 01:01:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 30 01:01:31.594244 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c1839-5479-4118-9b78-5f8d25ec294b None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:01:31.603368 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c1839-5479-4118-9b78-5f8d25ec294b None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:01:31.606919 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82744372-84e7-445e-9a0e-7670a28d3a26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:01:31.607509 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82744372-84e7-445e-9a0e-7670a28d3a26 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:01:31.607782 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82744372-84e7-445e-9a0e-7670a28d3a26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:01:31.608050 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82744372-84e7-445e-9a0e-7670a28d3a26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:01:31.667191 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82744372-84e7-445e-9a0e-7670a28d3a26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:01:31.668630 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82744372-84e7-445e-9a0e-7670a28d3a26 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:01:31.678818 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 664/1319] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 01:01:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:01:34.915171 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a96eb6-b320-4d66-9141-3deb52b50612 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:01:34.915621 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a96eb6-b320-4d66-9141-3deb52b50612 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:01:34.915710 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a96eb6-b320-4d66-9141-3deb52b50612 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:01:34.917327 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 656/1320] 10.222.0.40 () {54 vars in 921 bytes} [Sun Oct 30 01:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:01:34.929017 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91ca91-1db6-41ee-aa53-9893c5218386 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:01:34.929483 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91ca91-1db6-41ee-aa53-9893c5218386 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:01:34.929759 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91ca91-1db6-41ee-aa53-9893c5218386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:01:34.949758 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-6c91ca91-1db6-41ee-aa53-9893c5218386 None None] MFA Rules not processed for user `d7f009bdf1d24ee4b879db926b8d44cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:01:34.950967 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6c91ca91-1db6-41ee-aa53-9893c5218386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:01:34.960670 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 665/1321] 10.222.0.40 () {58 vars in 1018 bytes} [Sun Oct 30 01:01:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:01:34.976959 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a96eb6-b320-4d66-9141-3deb52b50612 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:01:34.992007 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a96eb6-b320-4d66-9141-3deb52b50612 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:01:34.997553 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6aff6a-864e-4a9b-80ee-d832e153ceb6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7f009bdf1d24ee4b879db926b8d44cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:01:34.998146 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6aff6a-864e-4a9b-80ee-d832e153ceb6 service placement] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:01:34.998418 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6aff6a-864e-4a9b-80ee-d832e153ceb6 service placement] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:01:34.998689 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6aff6a-864e-4a9b-80ee-d832e153ceb6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:01:35.008233 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6aff6a-864e-4a9b-80ee-d832e153ceb6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:01:35.009990 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6aff6a-864e-4a9b-80ee-d832e153ceb6 service placement] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:01:35.020983 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 657/1322] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 01:01:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:01:37.903966 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1235da-abd2-4810-a365-24d18bb1e42f None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:01:37.904428 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1235da-abd2-4810-a365-24d18bb1e42f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:01:37.904564 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1235da-abd2-4810-a365-24d18bb1e42f None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:01:37.905940 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 666/1323] 10.222.0.40 () {54 vars in 921 bytes} [Sun Oct 30 01:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:01:37.918136 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca47ba4-766a-47db-bfe6-8319d38d5f88 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:01:37.918576 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca47ba4-766a-47db-bfe6-8319d38d5f88 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:01:37.918652 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca47ba4-766a-47db-bfe6-8319d38d5f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:01:37.938383 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-7ca47ba4-766a-47db-bfe6-8319d38d5f88 None None] MFA Rules not processed for user `d7f009bdf1d24ee4b879db926b8d44cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:01:37.939494 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-7ca47ba4-766a-47db-bfe6-8319d38d5f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:01:37.948461 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 658/1324] 10.222.0.40 () {58 vars in 1018 bytes} [Sun Oct 30 01:01:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:01:37.964275 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1235da-abd2-4810-a365-24d18bb1e42f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:01:37.981262 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca47ba4-766a-47db-bfe6-8319d38d5f88 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:01:37.981865 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1235da-abd2-4810-a365-24d18bb1e42f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:01:37.987001 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ef59a-f923-4753-be86-ed5e142f2526 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7f009bdf1d24ee4b879db926b8d44cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:01:37.987599 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ef59a-f923-4753-be86-ed5e142f2526 service placement] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:01:37.988474 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ef59a-f923-4753-be86-ed5e142f2526 service placement] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:01:37.988757 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ef59a-f923-4753-be86-ed5e142f2526 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:01:37.997819 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ef59a-f923-4753-be86-ed5e142f2526 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:01:37.999257 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca47ba4-766a-47db-bfe6-8319d38d5f88 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:01:37.999392 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ef59a-f923-4753-be86-ed5e142f2526 service placement] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:01:38.003784 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2c9de-2358-4600-9d15-062ed6b2be2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:01:38.004403 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2c9de-2358-4600-9d15-062ed6b2be2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:01:38.004676 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2c9de-2358-4600-9d15-062ed6b2be2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:01:38.005128 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2c9de-2358-4600-9d15-062ed6b2be2a admin admin] PATH_INFO: `/v3/users/b8a65aed5ee544979ee1b460a71c99f8` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:01:38.006418 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2c9de-2358-4600-9d15-062ed6b2be2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8a65aed5ee544979ee1b460a71c99f8)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:01:38.008443 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2c9de-2358-4600-9d15-062ed6b2be2a admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:01:38.009470 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 667/1325] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 01:01:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:01:38.059904 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-09e2c9de-2358-4600-9d15-062ed6b2be2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8a65aed5ee544979ee1b460a71c99f8'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:01:38.067275 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-09e2c9de-2358-4600-9d15-062ed6b2be2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8a65aed5ee544979ee1b460a71c99f8'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:01:38.079504 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-09e2c9de-2358-4600-9d15-062ed6b2be2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8a65aed5ee544979ee1b460a71c99f8'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:01:38.080134 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-09e2c9de-2358-4600-9d15-062ed6b2be2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8a65aed5ee544979ee1b460a71c99f8'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:01:38.080756 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-09e2c9de-2358-4600-9d15-062ed6b2be2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8a65aed5ee544979ee1b460a71c99f8'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:01:38.092887 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 659/1326] 10.222.0.40 () {58 vars in 1224 bytes} [Sun Oct 30 01:01:37 2022] DELETE /identity/v3/users/b8a65aed5ee544979ee1b460a71c99f8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:01:38.341046 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ef59a-f923-4753-be86-ed5e142f2526 service placement] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:01:38.352733 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ef59a-f923-4753-be86-ed5e142f2526 service placement] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:01:38.413997 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b1a28-db40-4879-b94c-00dd5ff5bd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:01:38.414635 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b1a28-db40-4879-b94c-00dd5ff5bd72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:01:38.414939 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b1a28-db40-4879-b94c-00dd5ff5bd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:01:38.415209 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b1a28-db40-4879-b94c-00dd5ff5bd72 admin admin] PATH_INFO: `/v3/projects/74f4e7742d0d472fb38e1b3bc92cf179` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:01:38.416355 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b1a28-db40-4879-b94c-00dd5ff5bd72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74f4e7742d0d472fb38e1b3bc92cf179)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:01:38.418293 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b1a28-db40-4879-b94c-00dd5ff5bd72 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:01:38.466824 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a11b1a28-db40-4879-b94c-00dd5ff5bd72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74f4e7742d0d472fb38e1b3bc92cf179', 'request_id': 'req-a11b1a28-db40-4879-b94c-00dd5ff5bd72'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:01:38.474987 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a11b1a28-db40-4879-b94c-00dd5ff5bd72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74f4e7742d0d472fb38e1b3bc92cf179', 'request_id': 'req-a11b1a28-db40-4879-b94c-00dd5ff5bd72'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:01:38.477315 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:01:38.482302 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a11b1a28-db40-4879-b94c-00dd5ff5bd72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74f4e7742d0d472fb38e1b3bc92cf179', 'request_id': 'req-a11b1a28-db40-4879-b94c-00dd5ff5bd72'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:01:38.496928 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a11b1a28-db40-4879-b94c-00dd5ff5bd72 admin admin] The token cache is being invalidate because project 74f4e7742d0d472fb38e1b3bc92cf179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:01:38.497268 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a11b1a28-db40-4879-b94c-00dd5ff5bd72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:01:38.497882 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a11b1a28-db40-4879-b94c-00dd5ff5bd72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:01:38.499623 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 668/1327] 10.222.0.40 () {58 vars in 1233 bytes} [Sun Oct 30 01:01:38 2022] DELETE /identity/v3/projects/74f4e7742d0d472fb38e1b3bc92cf179 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:01:38.503529 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2c9de-2358-4600-9d15-062ed6b2be2a admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:01:38.505010 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-09e2c9de-2358-4600-9d15-062ed6b2be2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:01:38.526301 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2c9de-2358-4600-9d15-062ed6b2be2a admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:01:38.589676 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e27053-2f8c-4a07-b48b-ea50a59ad702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:01:38.590585 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e27053-2f8c-4a07-b48b-ea50a59ad702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:01:38.591027 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e27053-2f8c-4a07-b48b-ea50a59ad702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:01:38.591358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e27053-2f8c-4a07-b48b-ea50a59ad702 admin admin] PATH_INFO: `/v3/users/f219b8c3152040b38e4a5ed26a494651` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:01:38.593917 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e27053-2f8c-4a07-b48b-ea50a59ad702 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f219b8c3152040b38e4a5ed26a494651)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:01:38.596065 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e27053-2f8c-4a07-b48b-ea50a59ad702 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:01:38.610543 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:01:38.645508 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-48e27053-2f8c-4a07-b48b-ea50a59ad702 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f219b8c3152040b38e4a5ed26a494651'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:01:38.653438 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-48e27053-2f8c-4a07-b48b-ea50a59ad702 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f219b8c3152040b38e4a5ed26a494651'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:01:38.674668 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-48e27053-2f8c-4a07-b48b-ea50a59ad702 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f219b8c3152040b38e4a5ed26a494651'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:01:38.675437 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-48e27053-2f8c-4a07-b48b-ea50a59ad702 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f219b8c3152040b38e4a5ed26a494651'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:01:38.676067 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-48e27053-2f8c-4a07-b48b-ea50a59ad702 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f219b8c3152040b38e4a5ed26a494651'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:01:38.689142 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 660/1328] 10.222.0.40 () {58 vars in 1224 bytes} [Sun Oct 30 01:01:38 2022] DELETE /identity/v3/users/f219b8c3152040b38e4a5ed26a494651 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:01:38.862068 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b1a28-db40-4879-b94c-00dd5ff5bd72 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:01:38.864016 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a11b1a28-db40-4879-b94c-00dd5ff5bd72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:01:38.877514 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b1a28-db40-4879-b94c-00dd5ff5bd72 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:01:38.933567 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385cc4f-44b6-407a-b3c2-047123df97a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:01:38.934219 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385cc4f-44b6-407a-b3c2-047123df97a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:01:38.934496 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385cc4f-44b6-407a-b3c2-047123df97a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:01:38.934766 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385cc4f-44b6-407a-b3c2-047123df97a4 admin admin] PATH_INFO: `/v3/projects/b8b2d19b36e74a6f8ee67ae1dd7b5762` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:01:38.935871 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385cc4f-44b6-407a-b3c2-047123df97a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8b2d19b36e74a6f8ee67ae1dd7b5762)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:01:38.937793 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385cc4f-44b6-407a-b3c2-047123df97a4 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:01:38.982443 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7385cc4f-44b6-407a-b3c2-047123df97a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8b2d19b36e74a6f8ee67ae1dd7b5762', 'request_id': 'req-7385cc4f-44b6-407a-b3c2-047123df97a4'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:01:38.989122 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7385cc4f-44b6-407a-b3c2-047123df97a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8b2d19b36e74a6f8ee67ae1dd7b5762', 'request_id': 'req-7385cc4f-44b6-407a-b3c2-047123df97a4'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:01:38.994561 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7385cc4f-44b6-407a-b3c2-047123df97a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8b2d19b36e74a6f8ee67ae1dd7b5762', 'request_id': 'req-7385cc4f-44b6-407a-b3c2-047123df97a4'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:01:39.007066 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7385cc4f-44b6-407a-b3c2-047123df97a4 admin admin] The token cache is being invalidate because project b8b2d19b36e74a6f8ee67ae1dd7b5762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:01:39.007350 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7385cc4f-44b6-407a-b3c2-047123df97a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:01:39.007972 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7385cc4f-44b6-407a-b3c2-047123df97a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:01:39.009481 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 669/1329] 10.222.0.40 () {58 vars in 1233 bytes} [Sun Oct 30 01:01:38 2022] DELETE /identity/v3/projects/b8b2d19b36e74a6f8ee67ae1dd7b5762 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:01:48.685579 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=21,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:01:49.003958 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=55,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:02:12.746422 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb9793-3f91-4d4f-88a9-f289d88ecfb9 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:02:12.746935 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb9793-3f91-4d4f-88a9-f289d88ecfb9 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:02:12.746935 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb9793-3f91-4d4f-88a9-f289d88ecfb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:02:12.766059 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-0cbb9793-3f91-4d4f-88a9-f289d88ecfb9 None None] MFA Rules not processed for user `86918f2d1f5342eeb2b5d3ab5048296c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:02:12.767241 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-0cbb9793-3f91-4d4f-88a9-f289d88ecfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:02:12.820906 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 661/1330] 10.222.0.40 () {58 vars in 958 bytes} [Sun Oct 30 01:02:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:02:13.133456 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385cc4f-44b6-407a-b3c2-047123df97a4 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:02:13.134958 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7385cc4f-44b6-407a-b3c2-047123df97a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:02:13.191097 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385cc4f-44b6-407a-b3c2-047123df97a4 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:02:13.194693 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd668f78-bf0a-48f1-8c58-c5cac06ac210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:02:13.195291 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd668f78-bf0a-48f1-8c58-c5cac06ac210 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:02:13.195571 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd668f78-bf0a-48f1-8c58-c5cac06ac210 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:02:13.195844 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd668f78-bf0a-48f1-8c58-c5cac06ac210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:02:13.197646 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-cd668f78-bf0a-48f1-8c58-c5cac06ac210 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:02:13.206620 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd668f78-bf0a-48f1-8c58-c5cac06ac210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:02:13.208053 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd668f78-bf0a-48f1-8c58-c5cac06ac210 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:02:13.215756 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 670/1331] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 01:02:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:02:14.654545 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb9793-3f91-4d4f-88a9-f289d88ecfb9 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:02:14.655944 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-0cbb9793-3f91-4d4f-88a9-f289d88ecfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:02:14.724018 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb9793-3f91-4d4f-88a9-f289d88ecfb9 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:02:14.729551 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd4f29-4693-4167-83b9-bb782ae9f4bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7f009bdf1d24ee4b879db926b8d44cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:02:14.730150 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd4f29-4693-4167-83b9-bb782ae9f4bf service placement] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:02:14.730423 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd4f29-4693-4167-83b9-bb782ae9f4bf service placement] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:02:14.730685 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd4f29-4693-4167-83b9-bb782ae9f4bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:02:14.732401 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-badd4f29-4693-4167-83b9-bb782ae9f4bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:02:14.744336 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd4f29-4693-4167-83b9-bb782ae9f4bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:02:14.745920 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd4f29-4693-4167-83b9-bb782ae9f4bf service placement] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:02:14.756180 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 662/1332] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 01:02:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:02:23.212398 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=26 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:02:24.751707 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=57 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:02:30.290771 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd668f78-bf0a-48f1-8c58-c5cac06ac210 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:02:30.292320 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-cd668f78-bf0a-48f1-8c58-c5cac06ac210 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:02:30.366590 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd668f78-bf0a-48f1-8c58-c5cac06ac210 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:02:30.372081 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4740f24-b7cd-47c9-91cd-82635c822b25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4237b425d9fa4a60b10802e5b108d542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:02:30.372703 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4740f24-b7cd-47c9-91cd-82635c822b25 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:02:30.373091 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4740f24-b7cd-47c9-91cd-82635c822b25 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:02:30.373481 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4740f24-b7cd-47c9-91cd-82635c822b25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:02:30.375630 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b4740f24-b7cd-47c9-91cd-82635c822b25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:02:30.387998 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4740f24-b7cd-47c9-91cd-82635c822b25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:02:30.389567 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4740f24-b7cd-47c9-91cd-82635c822b25 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:02:30.400417 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 671/1333] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 01:02:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:02:40.395714 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=34 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:38.428180 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd4f29-4693-4167-83b9-bb782ae9f4bf service placement] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:03:38.429578 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-badd4f29-4693-4167-83b9-bb782ae9f4bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:38.510580 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd4f29-4693-4167-83b9-bb782ae9f4bf service placement] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:03:38.515607 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba1fd0-96b0-405d-bf1c-06a3662f1753 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7f009bdf1d24ee4b879db926b8d44cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:03:38.516202 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba1fd0-96b0-405d-bf1c-06a3662f1753 service placement] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:38.516478 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba1fd0-96b0-405d-bf1c-06a3662f1753 service placement] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:38.516749 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba1fd0-96b0-405d-bf1c-06a3662f1753 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:38.518493 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-e8ba1fd0-96b0-405d-bf1c-06a3662f1753 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:38.530087 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba1fd0-96b0-405d-bf1c-06a3662f1753 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:03:38.531646 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba1fd0-96b0-405d-bf1c-06a3662f1753 service placement] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:03:38.541356 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 663/1334] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 01:03:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:03:48.537395 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=37 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:17.997823 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4740f24-b7cd-47c9-91cd-82635c822b25 service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:04:18.035508 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4740f24-b7cd-47c9-91cd-82635c822b25 service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:04:18.039059 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7096654-ee03-4cde-ab6a-37fc70c96b44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93b5c95d6fd64262849f4c09fe0a716f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:04:18.039642 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7096654-ee03-4cde-ab6a-37fc70c96b44 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:18.039915 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7096654-ee03-4cde-ab6a-37fc70c96b44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:18.040179 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7096654-ee03-4cde-ab6a-37fc70c96b44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:18.041886 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c7096654-ee03-4cde-ab6a-37fc70c96b44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:18.122600 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7096654-ee03-4cde-ab6a-37fc70c96b44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:04:18.124020 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7096654-ee03-4cde-ab6a-37fc70c96b44 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:04:18.142487 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 672/1335] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 01:04:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:04:24.434427 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba1fd0-96b0-405d-bf1c-06a3662f1753 service placement] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:04:24.436558 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-e8ba1fd0-96b0-405d-bf1c-06a3662f1753 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:24.451162 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba1fd0-96b0-405d-bf1c-06a3662f1753 service placement] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:04:24.455868 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af67a0a-e2bd-4528-9980-f521eec738c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:04:24.456517 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af67a0a-e2bd-4528-9980-f521eec738c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:24.456808 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af67a0a-e2bd-4528-9980-f521eec738c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:24.457079 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af67a0a-e2bd-4528-9980-f521eec738c8 admin admin] PATH_INFO: `/v3/users/86918f2d1f5342eeb2b5d3ab5048296c` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:24.458228 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af67a0a-e2bd-4528-9980-f521eec738c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86918f2d1f5342eeb2b5d3ab5048296c)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:04:24.460140 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af67a0a-e2bd-4528-9980-f521eec738c8 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:04:24.510373 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-5af67a0a-e2bd-4528-9980-f521eec738c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86918f2d1f5342eeb2b5d3ab5048296c'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:04:24.519025 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-5af67a0a-e2bd-4528-9980-f521eec738c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86918f2d1f5342eeb2b5d3ab5048296c'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:04:24.531701 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-5af67a0a-e2bd-4528-9980-f521eec738c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86918f2d1f5342eeb2b5d3ab5048296c'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:04:24.532414 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-5af67a0a-e2bd-4528-9980-f521eec738c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86918f2d1f5342eeb2b5d3ab5048296c'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:04:24.533049 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-5af67a0a-e2bd-4528-9980-f521eec738c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86918f2d1f5342eeb2b5d3ab5048296c'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:04:24.550311 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 664/1336] 10.222.0.40 () {58 vars in 1224 bytes} [Sun Oct 30 01:04:24 2022] DELETE /identity/v3/users/86918f2d1f5342eeb2b5d3ab5048296c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:04:24.726499 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7096654-ee03-4cde-ab6a-37fc70c96b44 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:04:24.737007 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7096654-ee03-4cde-ab6a-37fc70c96b44 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:04:24.793459 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e6304-c098-4337-bc18-6dd76c9eb92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:04:24.794078 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e6304-c098-4337-bc18-6dd76c9eb92f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:24.794356 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e6304-c098-4337-bc18-6dd76c9eb92f admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:24.794625 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e6304-c098-4337-bc18-6dd76c9eb92f admin admin] PATH_INFO: `/v3/projects/3930cc14af6149c3aa4714f5fc902a76` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:24.795720 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e6304-c098-4337-bc18-6dd76c9eb92f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3930cc14af6149c3aa4714f5fc902a76)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:04:24.798175 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e6304-c098-4337-bc18-6dd76c9eb92f admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:04:24.837677 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:24.843984 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-970e6304-c098-4337-bc18-6dd76c9eb92f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3930cc14af6149c3aa4714f5fc902a76', 'request_id': 'req-970e6304-c098-4337-bc18-6dd76c9eb92f'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:04:24.850118 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-970e6304-c098-4337-bc18-6dd76c9eb92f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3930cc14af6149c3aa4714f5fc902a76', 'request_id': 'req-970e6304-c098-4337-bc18-6dd76c9eb92f'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:04:24.855628 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-970e6304-c098-4337-bc18-6dd76c9eb92f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3930cc14af6149c3aa4714f5fc902a76', 'request_id': 'req-970e6304-c098-4337-bc18-6dd76c9eb92f'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:04:24.867847 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-970e6304-c098-4337-bc18-6dd76c9eb92f admin admin] The token cache is being invalidate because project 3930cc14af6149c3aa4714f5fc902a76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:04:24.868130 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-970e6304-c098-4337-bc18-6dd76c9eb92f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:04:24.868761 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-970e6304-c098-4337-bc18-6dd76c9eb92f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:04:24.870251 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 673/1337] 10.222.0.40 () {58 vars in 1233 bytes} [Sun Oct 30 01:04:24 2022] DELETE /identity/v3/projects/3930cc14af6149c3aa4714f5fc902a76 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:04:24.874358 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af67a0a-e2bd-4528-9980-f521eec738c8 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:04:24.876317 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-5af67a0a-e2bd-4528-9980-f521eec738c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:24.889128 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af67a0a-e2bd-4528-9980-f521eec738c8 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:04:24.945123 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3a48f-ca76-401a-98e5-4a0ecc3fc3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:04:24.945756 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3a48f-ca76-401a-98e5-4a0ecc3fc3aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:24.946028 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3a48f-ca76-401a-98e5-4a0ecc3fc3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:24.946297 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3a48f-ca76-401a-98e5-4a0ecc3fc3aa admin admin] PATH_INFO: `/v3/users/12fce0a8db9f440685a5c53f066e4c84` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:24.947362 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3a48f-ca76-401a-98e5-4a0ecc3fc3aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=12fce0a8db9f440685a5c53f066e4c84)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:04:24.949295 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3a48f-ca76-401a-98e5-4a0ecc3fc3aa admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:04:24.994273 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-68f3a48f-ca76-401a-98e5-4a0ecc3fc3aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12fce0a8db9f440685a5c53f066e4c84'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:04:25.001744 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-68f3a48f-ca76-401a-98e5-4a0ecc3fc3aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12fce0a8db9f440685a5c53f066e4c84'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:04:25.013977 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-68f3a48f-ca76-401a-98e5-4a0ecc3fc3aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12fce0a8db9f440685a5c53f066e4c84'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:04:25.014759 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-68f3a48f-ca76-401a-98e5-4a0ecc3fc3aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12fce0a8db9f440685a5c53f066e4c84'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:04:25.015424 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-68f3a48f-ca76-401a-98e5-4a0ecc3fc3aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12fce0a8db9f440685a5c53f066e4c84'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:04:25.017526 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:25.030217 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 665/1338] 10.222.0.40 () {58 vars in 1224 bytes} [Sun Oct 30 01:04:24 2022] DELETE /identity/v3/users/12fce0a8db9f440685a5c53f066e4c84 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:04:25.198116 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e6304-c098-4337-bc18-6dd76c9eb92f admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:04:25.199615 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-970e6304-c098-4337-bc18-6dd76c9eb92f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:25.212571 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e6304-c098-4337-bc18-6dd76c9eb92f admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:04:25.270146 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eae5b3-80ce-4536-9463-dce81fb0782d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d17e3752b7a4a7facf7de1b529ec751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e03b1d71cb423ba48cad74d0a6e7da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:04:25.270767 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eae5b3-80ce-4536-9463-dce81fb0782d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:25.271045 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eae5b3-80ce-4536-9463-dce81fb0782d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:25.271318 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eae5b3-80ce-4536-9463-dce81fb0782d admin admin] PATH_INFO: `/v3/projects/ea7cb34b93f84071ae9d802741319c5c` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:25.272430 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eae5b3-80ce-4536-9463-dce81fb0782d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea7cb34b93f84071ae9d802741319c5c)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:04:25.274402 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eae5b3-80ce-4536-9463-dce81fb0782d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:04:25.320751 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a7eae5b3-80ce-4536-9463-dce81fb0782d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea7cb34b93f84071ae9d802741319c5c', 'request_id': 'req-a7eae5b3-80ce-4536-9463-dce81fb0782d'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:04:25.326953 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a7eae5b3-80ce-4536-9463-dce81fb0782d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea7cb34b93f84071ae9d802741319c5c', 'request_id': 'req-a7eae5b3-80ce-4536-9463-dce81fb0782d'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:04:25.332449 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a7eae5b3-80ce-4536-9463-dce81fb0782d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea7cb34b93f84071ae9d802741319c5c', 'request_id': 'req-a7eae5b3-80ce-4536-9463-dce81fb0782d'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:04:25.344591 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a7eae5b3-80ce-4536-9463-dce81fb0782d admin admin] The token cache is being invalidate because project ea7cb34b93f84071ae9d802741319c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:04:25.344878 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a7eae5b3-80ce-4536-9463-dce81fb0782d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:04:25.345494 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a7eae5b3-80ce-4536-9463-dce81fb0782d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:04:25.346948 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 674/1339] 10.222.0.40 () {58 vars in 1233 bytes} [Sun Oct 30 01:04:25 2022] DELETE /identity/v3/projects/ea7cb34b93f84071ae9d802741319c5c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:04:35.026837 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=4 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:35.341145 dv-osbrick-master-4-iscsi devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=60,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:08:44.387194 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3a48f-ca76-401a-98e5-4a0ecc3fc3aa admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:08:44.388603 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-68f3a48f-ca76-401a-98e5-4a0ecc3fc3aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:08:44.456439 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3a48f-ca76-401a-98e5-4a0ecc3fc3aa admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:08:44.513998 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702a690-5057-418b-9860-57fb61ad79b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7f009bdf1d24ee4b879db926b8d44cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8969ed754fe24784a2025cbdbf6f1a8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:08:44.514590 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702a690-5057-418b-9860-57fb61ad79b1 service placement] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:08:44.514885 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702a690-5057-418b-9860-57fb61ad79b1 service placement] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:08:44.515149 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702a690-5057-418b-9860-57fb61ad79b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:08:44.516864 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8702a690-5057-418b-9860-57fb61ad79b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:08:44.527475 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702a690-5057-418b-9860-57fb61ad79b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:08:44.529021 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702a690-5057-418b-9860-57fb61ad79b1 service placement] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:08:44.538939 dv-osbrick-master-4-iscsi devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 666/1340] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Oct 30 01:08:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)